Apr 15 22:15:09 devstack cinder-volume[72210]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 22:15:09 devstack cinder-volume[72210]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 22:15:09 devstack cinder-volume[72210]: we strongly recommend against using it for new projects. Apr 15 22:15:09 devstack cinder-volume[72210]: If you are already using Eventlet, we recommend migrating to a different Apr 15 22:15:09 devstack cinder-volume[72210]: framework. For more detail see Apr 15 22:15:09 devstack cinder-volume[72210]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 22:15:09 devstack cinder-volume[72210]: import eventlet # noqa Apr 15 22:15:11 devstack cinder-volume[72210]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 22:15:11 devstack cinder-volume[72210]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 22:15:11 devstack cinder-volume[72210]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 22:15:11 devstack cinder-volume[72210]: INFO dbcounter [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Registered counter for database cinder Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_db.sqlalchemy.engines [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG dbcounter [-] [72210] Writer thread running {{(pid=72210) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 22:15:12 devstack cinder-volume[72210]: INFO cinder.rpc [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 22:15:12 devstack cinder-volume[72210]: INFO cinder.rpc [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_db.sqlalchemy.engines [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:15:12 devstack cinder-volume[72210]: INFO cinder.volume.manager [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Determined volume DB was empty at startup. Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG cinder.volume.manager [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72210) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 22:15:12 devstack cinder-volume[72210]: INFO cinder.volume.manager [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 22:15:12 devstack cinder-volume[72210]: WARNING stevedore.named [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 22:15:12 devstack cinder-volume[72210]: WARNING castellan.key_manager [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 22:15:12 devstack cinder-volume[72210]: WARNING cinder.keymgr.conf_key_mgr [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG cinder.volume.drivers.lvm [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72210) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_concurrency.processutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_concurrency.processutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.281s {{(pid=72210) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_db.sqlalchemy.engines [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:15:12 devstack cinder-volume[72210]: INFO cinder.rpc [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 22:15:12 devstack cinder-volume[72210]: INFO cinder.rpc [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 22:15:12 devstack cinder-volume[72210]: WARNING stevedore.named [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 22:15:12 devstack cinder-volume[72210]: WARNING castellan.key_manager [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 22:15:12 devstack cinder-volume[72210]: INFO cinder.volume.manager [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_db.sqlalchemy.engines [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72210) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:15:12 devstack cinder-volume[72210]: INFO oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Starting 1 workers Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Started child 72318 {{(pid=72210) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Full set of CONF: {{(pid=72210) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] ******************************************************************************** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Configuration options gathered from: {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] ================================================================================ {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] allow_availability_zone_fallback = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] allow_compression_on_image_upload = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] allowed_direct_url_schemes = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] api_rate_limit = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] auth_strategy = keystone {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] az_cache_duration = 3600 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_availability_zone = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_host = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_stats_polling_interval = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backup_api_class = cinder.backup.api.API {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backup_name_template = backup-%s {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backup_use_same_host = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backup_use_temp_snapshot = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] chap_password = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] chap_username = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_internal_tenant_project_id = b74ea4c9c40742f299b57191bb37d1fc {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_internal_tenant_user_id = 449d2c0ec3b4481495eac8be2d4761d8 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cloned_volume_same_az = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cluster = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] compression_format = gzip {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] config_dir = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] config_source = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] control_exchange = openstack {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72318]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] debug = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] default_availability_zone = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] default_group_type = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] default_volume_type = lvmdriver-1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] disk_geometry = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] driver_client_cert = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] driver_client_cert_key = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] driver_data_namespace = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] driver_ssl_cert_path = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] driver_ssl_cert_verify = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] driver_use_ssl = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] enable_force_upload = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] enable_new_services = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] enable_unsupported_driver = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] enforce_multipath_for_image_xfer = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] filter_function = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_api_insecure = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_api_servers = ['http://192.168.122.14/image'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_api_ssl_compression = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_ca_certificates_file = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_num_retries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance_request_timeout = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] goodness_function = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] graceful_shutdown_timeout = 5 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] group_api_class = cinder.group.api.API {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] host = devstack {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_compress_on_upload = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_conversion_address_space_limit = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_conversion_cpu_limit = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_conversion_disable = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_upload_use_cinder_backend = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_upload_use_internal_tenant = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_volume_cache_enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_volume_cache_max_count = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] init_host_max_objects_retrieval = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] instance_format = [instance: %(uuid)s] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] iscsi_target_flags = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] iscsi_write_cache = on {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] iser_helper = tgtadm {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] iser_ip_address = 192.168.122.14 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] iser_port = 3260 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_color = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_config_append = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_dir = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_file = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_options = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_rotate_interval = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_rotate_interval_type = days {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] log_rotation_type = none {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] max_age = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] max_logfile_count = 30 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] max_logfile_size_mb = 200 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] max_over_subscription_ratio = 20.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] message_reap_interval = 86400 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] message_ttl = 2592000 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] monkey_patch = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] monkey_patch_modules = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] my_ip = 192.168.122.14 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] no_snapshot_gb_quota = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] num_iser_scan_tries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] num_shell_tries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] num_volume_device_scan_tries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] nvmeof_conn_info_version = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] nvmet_ns_id = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] nvmet_port_id = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] osapi_max_limit = 1000 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] osapi_volume_ext_list = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72318]: INFO cinder.volume.manager [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] osapi_volume_listen_port = 8776 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] osapi_volume_use_ssl = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] osapi_volume_workers = 2 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] per_volume_size_limit = -1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] periodic_fuzzy_delay = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] periodic_interval = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] public_endpoint = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] publish_errors = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] quota_backup_gigabytes = 1000 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] quota_backups = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] quota_gigabytes = 1000 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] quota_groups = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] quota_snapshots = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] quota_volumes = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] rate_limit_burst = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] rate_limit_except_level = CRITICAL {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] rate_limit_interval = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] reinit_driver_count = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] replication_device = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] report_discard_supported = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] report_interval = 120 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] reservation_clean_interval = 86400 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] reservation_expire = 86400 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] reserved_image_namespaces = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] reserved_percentage = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] rpc_response_timeout = 120 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] run_external_periodic_tasks = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] scst_target_driver = iscsi {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] scst_target_iqn_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_down_time = 720 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] shell_completion = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] snapshot_name_template = snapshot-%s {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] snapshot_same_host = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] split_loggers = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] state_path = /opt/stack/data/cinder {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] storage_availability_zone = nova {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] storage_protocol = iSCSI {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] syslog_log_facility = LOG_USER {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] target_helper = lioadm {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] target_ip_address = 192.168.122.14 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] target_port = 3260 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] target_protocol = iscsi {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] target_secondary_ip_addresses = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] trace_flags = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] transport_url = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] until_refresh = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] use_chap_auth = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] use_default_quota_class = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] use_journal = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] use_json = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] use_multipath_for_image_xfer = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] use_stderr = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] use_syslog = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] verify_glance_signatures = enabled {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_api_class = cinder.volume.api.API {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_backend_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_clear = zero {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_clear_ionice = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_clear_size = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_copy_bps_limit = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_dd_blocksize = 1M {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_name_template = volume-%s {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_service_inithost_offload = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volume_usage_audit_period = month {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] zoning_mode = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.admin_password = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.admin_token = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.admin_user = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_port = 35357 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_protocol = https {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_section = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_type = password {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_uri = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.auth_version = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.cache = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.identity_uri = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.insecure = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.interface = public {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_password = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcache_username = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.region_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.072s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.service_type = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.backend = dogpile.cache.null {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.backend_argument = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.backend_expiration_time = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.config_prefix = cache.oslo {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.debug_cache_backend = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.enable_retry_client = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.enable_socket_keepalive = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.enforce_fips_mode = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.expiration_time = 600 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.memcache_dead_retry = 300 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.memcache_sasl_enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.password = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.proxies = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.redis_db = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.redis_server = localhost:6379 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.retry_attempts = 2 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.retry_delay = 0.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.socket_keepalive_count = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.socket_keepalive_idle = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.socket_keepalive_interval = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.socket_timeout = 1.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.tls_allowed_ciphers = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.tls_cafile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.tls_certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.tls_enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.tls_keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cache.username = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] coordination.backend_url = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.asyncio_connection = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.asyncio_slave_connection = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.backend = sqlalchemy {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.connection = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.connection_debug = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.connection_parameters = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.connection_recycle_time = 3600 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.connection_trace = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.db_inc_retry_interval = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.db_max_retries = 20 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.db_max_retry_interval = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.db_retry_interval = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.max_overflow = 50 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.max_pool_size = 5 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.max_retries = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.pool_timeout = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.retry_interval = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.slave_connection = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.sqlite_synchronous = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.synchronous_reader = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] database.use_db_reconnect = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.connection_string = messaging:// {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.es_doc_type = notification {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.es_scroll_size = 10000 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.es_scroll_time = 2m {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.filter_error_trace = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.hmac_keys = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.sentinel_service_name = mymaster {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.socket_timeout = 0.1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.trace_requests = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler.trace_sqlalchemy = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler_jaeger.process_tags = {} {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] profiler_otlp.service_name_prefix = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.enforce_new_defaults = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: WARNING oslo_config.cfg [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.enforce_scope = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.policy_default_rule = default {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] privsep_osbrick.group = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] privsep_osbrick.helper_command = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] privsep_osbrick.user = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_sys_admin.group = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_sys_admin.helper_command = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] cinder_sys_admin.user = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.auth_section = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.auth_type = password {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.cafile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.collect_timing = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.insecure = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.send_service_user_token = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.split_loggers = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] service_user.timeout = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.auth_section = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.auth_type = password {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.collect_timing = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.insecure = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.region_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.split_loggers = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] glance.timeout = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.backend_availability_zone = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.chap_password = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.chap_username = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.disk_geometry = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.driver_client_cert = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.driver_data_namespace = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.driver_use_ssl = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.extra_capabilities = {} {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.filter_function = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.goodness_function = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.iscsi_target_flags = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.iser_port = 3260 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.lvm_share_target = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.lvm_type = auto {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.replication_device = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.report_discard_supported = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.target_helper = tgtadm {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.target_port = 3260 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.target_protocol = iscsi {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.trace_flags = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.use_chap_auth = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_backend_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_clear = zero {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_reports.file_event_handler = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_reports.log_dir = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.backend_host = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack sudo[72323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.chap_password = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.chap_username = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.disk_geometry = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.driver_client_cert = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.extra_capabilities = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.filter_function = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.goodness_function = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack sudo[72323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.iser_helper = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.iser_ip_address = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.iser_port = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.lvm_share_target = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.lvm_type = auto {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.num_shell_tries = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.replication_device = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.report_discard_supported = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.reserved_percentage = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.scst_target_driver = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.storage_protocol = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.target_helper = lioadm {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.target_ip_address = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.target_port = 3260 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.trace_flags = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.use_chap_auth = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_clear = zero {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_clear_size = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] lvmdriver-1.volumes_dir = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_notifications.driver = [] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] key_manager.fixed_key = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.barbican_api_version = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.barbican_endpoint = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.barbican_endpoint_type = public {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.barbican_region_name = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.cafile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.collect_timing = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.insecure = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.number_of_retries = 60 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.retry_delay = 1 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.send_service_user_token = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.split_loggers = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.timeout = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.verify_ssl = True {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican.verify_ssl_path = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.auth_section = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.auth_type = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.cafile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.certfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.collect_timing = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.insecure = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.keyfile = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.split_loggers = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] barbican_service_user.timeout = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.approle_role_id = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.approle_secret_id = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.kv_mountpoint = secret {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.kv_path = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.kv_version = 2 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.namespace = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.root_token_id = **** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.ssl_ca_crt_file = None {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.timeout = 60.0 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.use_ssl = False {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:15:12 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] ******************************************************************************** {{(pid=72210) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 22:15:13 devstack sudo[72323]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:13 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:13 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:13 devstack sudo[72463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:13 devstack sudo[72463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:13 devstack sudo[72463]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:13 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.556s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:13 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:15:14 devstack cinder-volume[72318]: INFO cinder.brick.local_dev.lvm [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 22:15:14 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:14 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:14 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:14 devstack sudo[72693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:15:14 devstack sudo[72693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:14 devstack sudo[72693]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:14 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.523s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:14 devstack cinder-volume[72318]: DEBUG cinder.brick.local_dev.lvm [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72318) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 22:15:14 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:14 devstack sudo[72845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:14 devstack sudo[72845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:15 devstack sudo[72845]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.816s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:15 devstack sudo[73001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:15 devstack sudo[73001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:15 devstack sudo[73001]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:15 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:15 devstack sudo[73014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 22:15:15 devstack sudo[73014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:16 devstack sudo[73014]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:16 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.418s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:16 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:16 devstack sudo[73018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:15:16 devstack sudo[73018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:16 devstack sudo[73018]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:16 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:16 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:16 devstack sudo[73023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:15:16 devstack sudo[73023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:17 devstack sudo[73023]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:17 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:17 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:17 devstack sudo[73029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:15:17 devstack sudo[73029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:17 devstack sudo[73029]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:17 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:17 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:17 devstack sudo[73034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:17 devstack sudo[73034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:18 devstack sudo[73034]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.424s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:18 devstack sudo[73039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:18 devstack sudo[73039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:18 devstack sudo[73039]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:18 devstack cinder-volume[72318]: INFO cinder.volume.drivers.lvm [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:18 devstack sudo[73043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:18 devstack sudo[73043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:18 devstack sudo[73043]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG cinder.volume.drivers.lvm [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Updating volume stats {{(pid=72318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 22:15:18 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:19 devstack sudo[73063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:15:19 devstack sudo[73063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:19 devstack sudo[73063]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:19 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:19 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:19 devstack sudo[73167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:15:19 devstack sudo[73167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:19 devstack sudo[73167]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:19 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:19 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:19 devstack sudo[73258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:19 devstack sudo[73258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:20 devstack sudo[73258]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:20 devstack sudo[73308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:15:20 devstack sudo[73308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:20 devstack sudo[73308]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:20 devstack cinder-volume[72318]: INFO cinder.volume.driver [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Driver hasn't implemented _init_vendor_properties() Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG cinder.volume.driver [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72318) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG oslo_db.sqlalchemy.engines [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG dbcounter [-] [72318] Writer thread running {{(pid=72318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG cinder.db.sqlalchemy.api [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Building query based on filter {{(pid=72318) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG cinder.image.image_utils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72318) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 22:15:20 devstack cinder-volume[72318]: INFO cinder.keymgr.migration [None req-32eeccca-331d-4266-9ba9-fb8eff1d15f3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG cinder.volume.drivers.lvm [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Updating volume stats {{(pid=72318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 22:15:20 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:20 devstack sudo[73313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:15:20 devstack sudo[73313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:21 devstack sudo[73313]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:21 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:21 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:21 devstack sudo[73316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:15:21 devstack sudo[73316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:21 devstack sudo[73316]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:21 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:21 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:21 devstack sudo[73322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:21 devstack sudo[73322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:22 devstack sudo[73322]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:22 devstack sudo[73327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:15:22 devstack sudo[73327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:22 devstack sudo[73327]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:22 devstack cinder-volume[72210]: DEBUG dbcounter [-] [72210] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72210) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG cinder.manager [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Notifying Schedulers of capabilities ... {{(pid=72318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:15:22 devstack cinder-volume[72318]: INFO cinder.volume.manager [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Driver initialization completed successfully. Apr 15 22:15:22 devstack cinder-volume[72318]: INFO cinder.manager [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Initiating service 2 cleanup Apr 15 22:15:22 devstack cinder-volume[72318]: INFO cinder.manager [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Service 2 cleanup completed. Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG cinder.service [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Creating RPC server for service cinder-volume {{(pid=72318) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG cinder.service [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72318) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 22:15:22 devstack cinder-volume[72318]: INFO cinder.volume.manager [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG cinder.volume.drivers.lvm [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Updating volume stats {{(pid=72318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 22:15:22 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:22 devstack sudo[73332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:15:22 devstack sudo[73332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:23 devstack sudo[73332]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:23 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:23 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:23 devstack sudo[73340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:15:23 devstack sudo[73340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:23 devstack sudo[73340]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:23 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:23 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:23 devstack sudo[73343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:15:23 devstack sudo[73343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:24 devstack sudo[73343]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:24 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.452s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:24 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:15:24 devstack sudo[73346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:15:24 devstack sudo[73346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:15:24 devstack sudo[73346]: pam_unix(sudo:session): session closed for user root Apr 15 22:15:24 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:15:24 devstack cinder-volume[72318]: INFO cinder.volume.manager [None req-86f175fb-7520-422f-9422-802da47ebe1f None None] Driver post RPC initialization completed successfully. Apr 15 22:15:34 devstack cinder-volume[72318]: DEBUG dbcounter [-] [72318] Writing DB stats cinder:SELECT=4 {{(pid=72318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:15:34 devstack cinder-volume[72318]: DEBUG dbcounter [-] [72318] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:16:35 devstack cinder-volume[72318]: DEBUG oslo_service.periodic_task [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:16:35 devstack cinder-volume[72318]: DEBUG cinder.volume.drivers.lvm [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Updating volume stats {{(pid=72318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 22:16:35 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:16:35 devstack sudo[78145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:16:35 devstack sudo[78145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:16:36 devstack sudo[78145]: pam_unix(sudo:session): session closed for user root Apr 15 22:16:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:16:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:16:36 devstack sudo[78148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:16:36 devstack sudo[78148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:16:36 devstack sudo[78148]: pam_unix(sudo:session): session closed for user root Apr 15 22:16:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:16:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:16:36 devstack sudo[78154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:16:36 devstack sudo[78154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:16:36 devstack sudo[78154]: pam_unix(sudo:session): session closed for user root Apr 15 22:16:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:16:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:16:37 devstack sudo[78158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:16:37 devstack sudo[78158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:16:37 devstack sudo[78158]: pam_unix(sudo:session): session closed for user root Apr 15 22:16:37 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:16:37 devstack cinder-volume[72318]: DEBUG cinder.manager [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Notifying Schedulers of capabilities ... {{(pid=72318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:17:34 devstack cinder-volume[72318]: DEBUG dbcounter [-] [72318] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72318) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:17:35 devstack cinder-volume[72318]: DEBUG oslo_service.periodic_task [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:17:35 devstack cinder-volume[72318]: DEBUG cinder.volume.drivers.lvm [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Updating volume stats {{(pid=72318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 22:17:35 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:17:35 devstack sudo[79692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:17:35 devstack sudo[79692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:17:36 devstack sudo[79692]: pam_unix(sudo:session): session closed for user root Apr 15 22:17:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.436s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:17:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:17:36 devstack sudo[79707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:17:36 devstack sudo[79707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:17:36 devstack sudo[79707]: pam_unix(sudo:session): session closed for user root Apr 15 22:17:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:17:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:17:36 devstack sudo[79739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:17:36 devstack sudo[79739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:17:37 devstack sudo[79739]: pam_unix(sudo:session): session closed for user root Apr 15 22:17:37 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:17:37 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:17:37 devstack sudo[79756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:17:37 devstack sudo[79756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:17:37 devstack sudo[79756]: pam_unix(sudo:session): session closed for user root Apr 15 22:17:37 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:17:37 devstack cinder-volume[72318]: DEBUG cinder.manager [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Notifying Schedulers of capabilities ... {{(pid=72318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:18:35 devstack cinder-volume[72318]: DEBUG oslo_service.periodic_task [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72318) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:18:35 devstack cinder-volume[72318]: DEBUG cinder.volume.drivers.lvm [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Updating volume stats {{(pid=72318) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 22:18:35 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:35 devstack sudo[81074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 22:18:35 devstack sudo[81074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:36 devstack sudo[81074]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.429s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:36 devstack sudo[81092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:18:36 devstack sudo[81092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:36 devstack sudo[81092]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:36 devstack sudo[81106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 22:18:36 devstack sudo[81106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:36 devstack sudo[81106]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:36 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:36 devstack sudo[81111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 22:18:36 devstack sudo[81111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:37 devstack sudo[81111]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:37 devstack cinder-volume[72318]: DEBUG oslo_concurrency.processutils [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.412s {{(pid=72318) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:37 devstack cinder-volume[72318]: DEBUG cinder.manager [None req-589221de-5252-4775-99f1-96ac063a0f7d None None] Notifying Schedulers of capabilities ... {{(pid=72318) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:18:42 devstack cinder-volume[72210]: INFO oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Caught SIGTERM, stopping children Apr 15 22:18:42 devstack cinder-volume[72210]: DEBUG oslo_concurrency.lockutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Acquiring lock "singleton_lock" {{(pid=72210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 22:18:42 devstack cinder-volume[72210]: DEBUG oslo_concurrency.lockutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Acquired lock "singleton_lock" {{(pid=72210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 22:18:42 devstack cinder-volume[72210]: DEBUG oslo_concurrency.lockutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Releasing lock "singleton_lock" {{(pid=72210) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 22:18:42 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Stop services. {{(pid=72210) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 22:18:42 devstack cinder-volume[72210]: DEBUG oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Killing children. {{(pid=72210) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 22:18:42 devstack cinder-volume[72210]: INFO oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Waiting on 1 children to exit Apr 15 22:18:47 devstack cinder-volume[72318]: DEBUG oslo_concurrency.lockutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Acquiring lock "singleton_lock" {{(pid=72318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 22:18:47 devstack cinder-volume[72318]: DEBUG oslo_concurrency.lockutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Acquired lock "singleton_lock" {{(pid=72318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 22:18:47 devstack cinder-volume[72318]: DEBUG oslo_concurrency.lockutils [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Releasing lock "singleton_lock" {{(pid=72318) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 22:18:47 devstack cinder-volume[72318]: WARNING amqp [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 22:18:47 devstack cinder-volume[72318]: WARNING amqp [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 22:18:47 devstack cinder-volume[72210]: INFO oslo_service.backend._eventlet.service [None req-d34e63b2-f4fe-48de-bfdc-e11f9bc874a2 None None] Child 72318 exited with status 0 Apr 15 22:18:47 devstack cinder-volume[81378]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 22:18:47 devstack cinder-volume[81378]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 22:18:47 devstack cinder-volume[81378]: we strongly recommend against using it for new projects. Apr 15 22:18:47 devstack cinder-volume[81378]: If you are already using Eventlet, we recommend migrating to a different Apr 15 22:18:47 devstack cinder-volume[81378]: framework. For more detail see Apr 15 22:18:47 devstack cinder-volume[81378]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 22:18:47 devstack cinder-volume[81378]: import eventlet # noqa Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 22:18:50 devstack cinder-volume[81378]: INFO dbcounter [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Registered counter for database cinder Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG oslo_db.sqlalchemy.engines [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG dbcounter [-] [81378] Writer thread running {{(pid=81378) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 22:18:50 devstack cinder-volume[81378]: INFO cinder.rpc [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 22:18:50 devstack cinder-volume[81378]: INFO cinder.rpc [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG oslo_db.sqlalchemy.engines [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:18:50 devstack cinder-volume[81378]: INFO cinder.volume.manager [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Determined volume DB was empty at startup. Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG cinder.volume.manager [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81378) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 22:18:50 devstack cinder-volume[81378]: INFO cinder.volume.manager [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 22:18:50 devstack cinder-volume[81378]: WARNING stevedore.named [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 22:18:50 devstack cinder-volume[81378]: WARNING castellan.key_manager [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 22:18:50 devstack cinder-volume[81378]: WARNING cinder.keymgr.conf_key_mgr [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 22:18:50 devstack cinder-volume[81378]: INFO cinder.volume.manager [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 22:18:50 devstack cinder-volume[81378]: DEBUG oslo_db.sqlalchemy.engines [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81378) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:18:51 devstack cinder-volume[81378]: INFO oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Starting 1 workers Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Started child 81496 {{(pid=81378) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Full set of CONF: {{(pid=81378) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] ******************************************************************************** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Configuration options gathered from: {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] ================================================================================ {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 22:18:51 devstack cinder-volume[81496]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] allow_availability_zone_fallback = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] allow_compression_on_image_upload = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] allowed_direct_url_schemes = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] api_rate_limit = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] auth_strategy = keystone {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_availability_zone = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_host = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_stats_polling_interval = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backup_api_class = cinder.backup.api.API {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backup_name_template = backup-%s {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backup_use_same_host = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backup_use_temp_snapshot = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] chap_password = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] chap_username = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_internal_tenant_project_id = b74ea4c9c40742f299b57191bb37d1fc {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_internal_tenant_user_id = 449d2c0ec3b4481495eac8be2d4761d8 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cluster = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] compression_format = gzip {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] compute_api_class = cinder.compute.nova.API {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] config_dir = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] config_source = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] control_exchange = openstack {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] debug = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] default_availability_zone = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] default_group_type = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] default_volume_type = QuobyteHD {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] disk_geometry = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] driver_client_cert = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] driver_client_cert_key = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] driver_data_namespace = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] driver_ssl_cert_path = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] driver_ssl_cert_verify = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] driver_use_ssl = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] enable_new_services = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] enable_unsupported_driver = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] enabled_backends = ['QuobyteHD'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] enforce_multipath_for_image_xfer = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] filter_function = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_api_insecure = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_api_servers = ['http://192.168.122.14/image'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_api_ssl_compression = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_ca_certificates_file = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_catalog_info = image:glance:publicURL {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_num_retries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance_request_timeout = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] goodness_function = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] graceful_shutdown_timeout = 5 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] group_api_class = cinder.group.api.API {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] host = devstack {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_compress_on_upload = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_conversion_address_space_limit = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_conversion_cpu_limit = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_conversion_disable = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_upload_use_cinder_backend = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_upload_use_internal_tenant = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_volume_cache_enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_volume_cache_max_count = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81496]: INFO cinder.volume.manager [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] image_volume_cache_max_size_gb = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] init_host_max_objects_retrieval = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] instance_format = [instance: %(uuid)s] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] iscsi_target_flags = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] iscsi_write_cache = on {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.remotefs [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81496) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] iser_helper = tgtadm {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] iser_ip_address = 192.168.122.14 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] iser_port = 3260 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_color = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_config_append = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_dir = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_file = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_options = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_rotate_interval = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_rotate_interval_type = days {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] log_rotation_type = none {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] max_age = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] max_logfile_count = 30 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] max_logfile_size_mb = 200 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] max_over_subscription_ratio = 20.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] message_reap_interval = 86400 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] message_ttl = 2592000 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] migration_create_volume_timeout_secs = 300 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] monkey_patch = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] monkey_patch_modules = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] my_ip = 192.168.122.14 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] no_snapshot_gb_quota = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] num_iser_scan_tries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] num_shell_tries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] num_volume_device_scan_tries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] nvmeof_conn_info_version = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] nvmet_ns_id = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] nvmet_port_id = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] osapi_max_limit = 1000 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] osapi_volume_ext_list = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] osapi_volume_listen_port = 8776 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] osapi_volume_use_ssl = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] osapi_volume_workers = 2 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] per_volume_size_limit = -1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] periodic_fuzzy_delay = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] periodic_interval = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] public_endpoint = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] publish_errors = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] quota_backup_gigabytes = 1000 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] quota_backups = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] quota_gigabytes = 1000 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] quota_groups = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] quota_snapshots = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] quota_volumes = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] rate_limit_burst = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] rate_limit_except_level = CRITICAL {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] rate_limit_interval = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] reinit_driver_count = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] replication_device = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] report_discard_supported = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] report_interval = 120 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] reservation_clean_interval = 86400 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] reservation_expire = 86400 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] reserved_image_namespaces = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] reserved_percentage = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] rpc_response_timeout = 120 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] run_external_periodic_tasks = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] scst_target_driver = iscsi {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] scst_target_iqn_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_down_time = 720 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] shell_completion = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] snapshot_name_template = snapshot-%s {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] split_loggers = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] state_path = /opt/stack/data/cinder {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] storage_availability_zone = nova {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] storage_protocol = iSCSI {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] syslog_log_facility = LOG_USER {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] target_helper = lioadm {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] target_ip_address = 192.168.122.14 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] target_port = 3260 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] target_protocol = iscsi {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] target_secondary_ip_addresses = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] trace_flags = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] transport_url = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] until_refresh = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] use_chap_auth = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] use_default_quota_class = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] use_journal = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] use_json = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] use_multipath_for_image_xfer = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] use_stderr = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] use_syslog = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] verify_glance_signatures = enabled {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_api_class = cinder.volume.api.API {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_backend_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_clear = zero {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_clear_ionice = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_clear_size = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_copy_bps_limit = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_dd_blocksize = 1M {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_name_template = volume-%s {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_service_inithost_offload = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volume_usage_audit_period = month {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] zoning_mode = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_concurrency.disable_process_locking = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.admin_password = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.admin_token = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.admin_user = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_port = 35357 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_protocol = https {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_section = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_type = password {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_uri = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.auth_version = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.cache = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81496) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 22:18:51 devstack cinder-volume[81496]: WARNING cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 22:18:51 devstack cinder-volume[81496]: WARNING cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.identity_uri = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.include_service_catalog = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.insecure = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Running cmd (subprocess): mount.quobyte {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.interface = public {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_password = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcache_username = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.region_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.service_type = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.backend = dogpile.cache.null {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.backend_argument = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.backend_expiration_time = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.config_prefix = cache.oslo {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.debug_cache_backend = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.enable_retry_client = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.enable_socket_keepalive = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.enforce_fips_mode = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.expiration_time = 600 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.hashclient_retry_attempts = 2 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.memcache_dead_retry = 300 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.memcache_pool_maxsize = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.memcache_sasl_enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.password = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.proxies = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.redis_db = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.redis_server = localhost:6379 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.retry_attempts = 2 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.retry_delay = 0.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.socket_keepalive_count = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.socket_keepalive_idle = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.socket_keepalive_interval = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.socket_timeout = 1.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.tls_allowed_ciphers = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.tls_cafile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.tls_certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.tls_enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.tls_keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cache.username = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] coordination.backend_url = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.asyncio_connection = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.asyncio_slave_connection = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.backend = sqlalchemy {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.connection = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.connection_debug = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.connection_parameters = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.connection_recycle_time = 3600 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.connection_trace = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.db_inc_retry_interval = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.db_max_retries = 20 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.db_max_retry_interval = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.db_retry_interval = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.max_overflow = 50 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.max_pool_size = 5 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.max_retries = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.mysql_wsrep_sync_wait = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.pool_timeout = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.retry_interval = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.slave_connection = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.sqlite_synchronous = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.synchronous_reader = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] database.use_db_reconnect = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.connection_string = messaging:// {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.es_doc_type = notification {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.es_scroll_size = 10000 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.es_scroll_time = 2m {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.filter_error_trace = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.hmac_keys = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.sentinel_service_name = mymaster {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.socket_timeout = 0.1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.trace_requests = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler.trace_sqlalchemy = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler_jaeger.process_tags = {} {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler_jaeger.service_name_prefix = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] profiler_otlp.service_name_prefix = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.enforce_new_defaults = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: WARNING oslo_config.cfg [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.enforce_scope = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.policy_default_rule = default {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.policy_file = policy.yaml {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] privsep_osbrick.group = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] privsep_osbrick.helper_command = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] privsep_osbrick.user = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_sys_admin.group = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_sys_admin.helper_command = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] cinder_sys_admin.user = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.auth_section = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.auth_type = password {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.cafile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.collect_timing = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.insecure = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.send_service_user_token = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.split_loggers = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] service_user.timeout = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.auth_section = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.auth_type = password {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.collect_timing = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.insecure = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.region_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.split_loggers = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] glance.timeout = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.backend_availability_zone = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.chap_password = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.chap_username = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.disk_geometry = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.driver_client_cert = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.driver_client_cert_key = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.driver_data_namespace = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack quobyte-client[81497]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 22:18:51 devstack quobyte-client[81497]: Invalid parameters found, error: missing mount point. Apr 15 22:18:51 devstack quobyte-client[81497]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 22:18:51 devstack quobyte-client[81497]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.driver_use_ssl = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.extra_capabilities = {} {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.filter_function = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.goodness_function = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.iscsi_target_flags = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.iscsi_write_cache = on {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.iser_helper = tgtadm {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.iser_port = 3260 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_host = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_login = admin {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_mount_options = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_password = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_private_key = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_share_path = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.num_shell_tries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] CMD "mount.quobyte" returned: 1 in 0.089s {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81496) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81496]: INFO cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 ... Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf -c /etc/quobyte/client-cinder.cfg {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.quobyte_volume_url = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.replication_device = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.report_discard_supported = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.reserved_percentage = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.target_helper = tgtadm {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.target_port = 3260 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.target_protocol = iscsi {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.trace_flags = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.unique_fqdn_network = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.use_chap_auth = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_backend_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_clear = zero {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_clear_ionice = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_clear_size = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_reports.file_event_handler = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_reports.log_dir = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.backend_availability_zone = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.backend_host = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.chap_password = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.chap_username = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.chiscsi_conf = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.disk_geometry = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack sudo[81498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf -c /etc/quobyte/client-cinder.cfg Apr 15 22:18:51 devstack sudo[81498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.driver_client_cert = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.driver_data_namespace = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.driver_use_ssl = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.extra_capabilities = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.filter_function = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.goodness_function = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.iser_helper = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.iser_ip_address = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.iser_port = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.iser_target_prefix = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_host = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_login = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_mount_options = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_password = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_private_key = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_share_path = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_ssh_port = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.num_shell_tries = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.nvmet_port_id = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.replication_device = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.report_discard_supported = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.reserved_percentage = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.scst_target_driver = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.storage_protocol = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.target_helper = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.target_ip_address = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.target_port = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.target_prefix = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.target_protocol = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.trace_flags = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.use_chap_auth = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_clear = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_clear_size = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] QuobyteHD.volumes_dir = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.ssl = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_notifications.driver = [] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_notifications.retry = -1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] key_manager.fixed_key = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.barbican_api_version = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.barbican_endpoint = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.barbican_endpoint_type = public {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.barbican_region_name = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.cafile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.collect_timing = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.insecure = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.number_of_retries = 60 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.retry_delay = 1 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.send_service_user_token = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.split_loggers = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.timeout = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.verify_ssl = True {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican.verify_ssl_path = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.auth_section = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.auth_type = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.cafile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.certfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.collect_timing = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.insecure = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.keyfile = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.split_loggers = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] barbican_service_user.timeout = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.approle_role_id = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.approle_secret_id = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.kv_mountpoint = secret {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.kv_path = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.kv_version = 2 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.namespace = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.root_token_id = **** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.ssl_ca_crt_file = None {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.timeout = 60.0 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.use_ssl = False {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:18:51 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] ******************************************************************************** {{(pid=81378) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 22:18:51 devstack sudo[81498]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.602s {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:51 devstack cinder-volume[81496]: INFO cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 succeeded Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81496) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.610s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:18:51 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:51 devstack sudo[81568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:18:51 devstack sudo[81568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:52 devstack sudo[81568]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.491s {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:52 devstack cinder-volume[81496]: INFO cinder.volume.driver [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.volume.driver [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7148971557617, 'free_capacity_gb': 1775.7148971557617, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81496) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_db.sqlalchemy.engines [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81496) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG dbcounter [-] [81496] Writer thread running {{(pid=81496) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.db.sqlalchemy.api [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Building query based on filter {{(pid=81496) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.image.image_utils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81496) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 22:18:52 devstack cinder-volume[81496]: INFO cinder.keymgr.migration [None req-58364097-0333-4de9-99b5-8fa44fd65560 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81496) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81496) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:52 devstack sudo[81572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:18:52 devstack sudo[81572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:52 devstack sudo[81572]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.448s {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.manager [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Notifying Schedulers of capabilities ... {{(pid=81496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:18:52 devstack cinder-volume[81496]: INFO cinder.volume.manager [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Driver initialization completed successfully. Apr 15 22:18:52 devstack cinder-volume[81496]: INFO cinder.manager [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Initiating service 3 cleanup Apr 15 22:18:52 devstack cinder-volume[81496]: INFO cinder.manager [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Service 3 cleanup completed. Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.service [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Creating RPC server for service cinder-volume {{(pid=81496) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.service [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81496) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 22:18:52 devstack cinder-volume[81496]: INFO cinder.volume.manager [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81496) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81496) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:18:52 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:52 devstack sudo[81578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:18:52 devstack sudo[81578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:53 devstack sudo[81578]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:53 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.578s {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:53 devstack cinder-volume[81496]: INFO cinder.volume.manager [None req-c607dc6b-5f45-4385-8e99-c5213df98102 None None] Driver post RPC initialization completed successfully. Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81496) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG cinder.volume.drivers.quobyte [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81496) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81496) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:18:56 devstack sudo[81642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:18:56 devstack sudo[81642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:18:56 devstack sudo[81642]: pam_unix(sudo:session): session closed for user root Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG oslo_concurrency.processutils [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.381s {{(pid=81496) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:18:56 devstack cinder-volume[81496]: DEBUG cinder.manager [None req-cdd2791c-d9c0-4611-a14e-deccb30ab85d None None] Notifying Schedulers of capabilities ... {{(pid=81496) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:19:00 devstack cinder-volume[81378]: INFO oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Caught SIGTERM, stopping children Apr 15 22:19:00 devstack cinder-volume[81378]: DEBUG oslo_concurrency.lockutils [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Acquiring lock "singleton_lock" {{(pid=81378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 22:19:00 devstack cinder-volume[81378]: DEBUG oslo_concurrency.lockutils [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Acquired lock "singleton_lock" {{(pid=81378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 22:19:00 devstack cinder-volume[81378]: DEBUG oslo_concurrency.lockutils [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Releasing lock "singleton_lock" {{(pid=81378) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 22:19:00 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Stop services. {{(pid=81378) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 22:19:00 devstack cinder-volume[81378]: DEBUG oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Killing children. {{(pid=81378) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 22:19:00 devstack cinder-volume[81378]: INFO oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Waiting on 1 children to exit Apr 15 22:19:01 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Acquiring lock "singleton_lock" {{(pid=81496) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 22:19:01 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Acquired lock "singleton_lock" {{(pid=81496) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 22:19:01 devstack cinder-volume[81496]: DEBUG oslo_concurrency.lockutils [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Releasing lock "singleton_lock" {{(pid=81496) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 22:19:01 devstack cinder-volume[81496]: WARNING amqp [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 22:19:01 devstack cinder-volume[81496]: WARNING amqp [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 22:19:01 devstack cinder-volume[81378]: INFO oslo_service.backend._eventlet.service [None req-e85735b2-5076-4e83-a76c-d12edfe86195 None None] Child 81496 exited with status 0 Apr 15 22:19:01 devstack cinder-volume[81722]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 22:19:01 devstack cinder-volume[81722]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 22:19:01 devstack cinder-volume[81722]: we strongly recommend against using it for new projects. Apr 15 22:19:01 devstack cinder-volume[81722]: If you are already using Eventlet, we recommend migrating to a different Apr 15 22:19:01 devstack cinder-volume[81722]: framework. For more detail see Apr 15 22:19:01 devstack cinder-volume[81722]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 22:19:01 devstack cinder-volume[81722]: import eventlet # noqa Apr 15 22:19:03 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 22:19:03 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 22:19:03 devstack cinder-volume[81722]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81722) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 22:19:03 devstack cinder-volume[81722]: INFO dbcounter [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Registered counter for database cinder Apr 15 22:19:03 devstack cinder-volume[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG dbcounter [-] [81722] Writer thread running {{(pid=81722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 22:19:04 devstack cinder-volume[81722]: INFO cinder.rpc [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 22:19:04 devstack cinder-volume[81722]: INFO cinder.rpc [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:19:04 devstack cinder-volume[81722]: INFO cinder.volume.manager [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Determined volume DB was empty at startup. Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG cinder.volume.manager [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81722) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 22:19:04 devstack cinder-volume[81722]: WARNING stevedore.named [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 22:19:04 devstack cinder-volume[81722]: WARNING castellan.key_manager [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 22:19:04 devstack cinder-volume[81722]: WARNING cinder.keymgr.conf_key_mgr [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 22:19:04 devstack cinder-volume[81722]: INFO cinder.volume.manager [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_db.sqlalchemy.engines [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81722) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:19:04 devstack cinder-volume[81722]: INFO oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Starting 1 workers Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Started child 81921 {{(pid=81722) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Full set of CONF: {{(pid=81722) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] ******************************************************************************** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Configuration options gathered from: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] ================================================================================ {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] allow_availability_zone_fallback = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] allow_compression_on_image_upload = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] allowed_direct_url_schemes = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] api_rate_limit = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] auth_strategy = keystone {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_availability_zone = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_host = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_stats_polling_interval = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backup_api_class = cinder.backup.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backup_name_template = backup-%s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backup_use_same_host = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backup_use_temp_snapshot = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] chap_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] chap_username = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_internal_tenant_project_id = b74ea4c9c40742f299b57191bb37d1fc {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_internal_tenant_user_id = 449d2c0ec3b4481495eac8be2d4761d8 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cluster = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] compression_format = gzip {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] compute_api_class = cinder.compute.nova.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] config_dir = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] config_source = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] control_exchange = openstack {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] debug = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] default_availability_zone = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] default_group_type = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] default_volume_type = QuobyteHD {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] disk_geometry = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] driver_client_cert = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] driver_client_cert_key = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] driver_data_namespace = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] driver_ssl_cert_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] driver_ssl_cert_verify = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] driver_use_ssl = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] enable_new_services = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] enable_unsupported_driver = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] enabled_backends = ['QuobyteHD'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] enforce_multipath_for_image_xfer = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] filter_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_api_insecure = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_api_servers = ['http://192.168.122.14/image'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_api_ssl_compression = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_ca_certificates_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_catalog_info = image:glance:publicURL {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81921]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_num_retries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance_request_timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] goodness_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] graceful_shutdown_timeout = 5 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] group_api_class = cinder.group.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] host = devstack {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_compress_on_upload = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_conversion_address_space_limit = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_conversion_cpu_limit = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_conversion_disable = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_upload_use_cinder_backend = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_upload_use_internal_tenant = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_volume_cache_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_volume_cache_max_count = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] image_volume_cache_max_size_gb = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] init_host_max_objects_retrieval = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] instance_format = [instance: %(uuid)s] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] iscsi_target_flags = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] iscsi_write_cache = on {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] iser_helper = tgtadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] iser_ip_address = 192.168.122.14 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] iser_port = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_color = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_config_append = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_dir = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_options = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_rotate_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_rotate_interval_type = days {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] log_rotation_type = none {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] max_age = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] max_logfile_count = 30 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] max_logfile_size_mb = 200 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] max_over_subscription_ratio = 20.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] message_reap_interval = 86400 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] message_ttl = 2592000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] migration_create_volume_timeout_secs = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] monkey_patch = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] monkey_patch_modules = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] my_ip = 192.168.122.14 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] no_snapshot_gb_quota = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] num_iser_scan_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] num_shell_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] num_volume_device_scan_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] nvmeof_conn_info_version = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] nvmet_ns_id = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] nvmet_port_id = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] osapi_max_limit = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] osapi_volume_ext_list = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] osapi_volume_listen = 0.0.0.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] osapi_volume_listen_port = 8776 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] osapi_volume_use_ssl = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] osapi_volume_workers = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] per_volume_size_limit = -1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] periodic_fuzzy_delay = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] periodic_interval = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] project_id_regex = [0-9a-f\-]+ {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] public_endpoint = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] publish_errors = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] quota_backup_gigabytes = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] quota_backups = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] quota_gigabytes = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] quota_groups = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] quota_snapshots = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] quota_volumes = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] rate_limit_burst = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] rate_limit_except_level = CRITICAL {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] rate_limit_interval = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] reinit_driver_count = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] replication_device = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] report_discard_supported = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] report_interval = 120 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] reservation_clean_interval = 86400 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] reservation_expire = 86400 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] reserved_image_namespaces = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] reserved_percentage = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] rpc_response_timeout = 120 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] run_external_periodic_tasks = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] scst_target_driver = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] scst_target_iqn_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_down_time = 720 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] shell_completion = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] snapshot_name_template = snapshot-%s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] split_loggers = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] state_path = /opt/stack/data/cinder {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] storage_availability_zone = nova {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] storage_protocol = iSCSI {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] syslog_log_facility = LOG_USER {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] target_helper = lioadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] target_ip_address = 192.168.122.14 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] target_port = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] target_protocol = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] target_secondary_ip_addresses = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] trace_flags = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] transfer_api_class = cinder.transfer.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] transport_url = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] until_refresh = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] use_chap_auth = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] use_default_quota_class = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] use_journal = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] use_json = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] use_multipath_for_image_xfer = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] use_stderr = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] use_syslog = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] verify_glance_signatures = enabled {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_api_class = cinder.volume.api.API {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_backend_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_clear = zero {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_clear_ionice = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_clear_size = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_copy_bps_limit = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_dd_blocksize = 1M {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_name_template = volume-%s {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_service_inithost_offload = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volume_usage_audit_period = month {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] zoning_mode = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_concurrency.disable_process_locking = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.admin_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.admin_token = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.admin_user = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_admin_prefix = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_port = 35357 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_protocol = https {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_section = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_type = password {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_uri = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.auth_version = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.cache = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.delay_auth_decision = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.http_connect_timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.identity_uri = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.include_service_catalog = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.insecure = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.interface = public {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_password = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcache_username = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.region_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.service_token_roles_required = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.service_type = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.token_cache_time = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.backend = dogpile.cache.null {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.backend_argument = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.backend_expiration_time = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.config_prefix = cache.oslo {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.debug_cache_backend = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.enable_retry_client = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.enable_socket_keepalive = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.enforce_fips_mode = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.expiration_time = 600 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.hashclient_retry_attempts = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.memcache_dead_retry = 300 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.memcache_pool_maxsize = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.memcache_sasl_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.proxies = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.redis_db = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.redis_sentinel_service_name = mymaster {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.redis_server = localhost:6379 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.retry_attempts = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.retry_delay = 0.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.socket_keepalive_count = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.socket_keepalive_idle = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.socket_keepalive_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.socket_timeout = 1.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.tls_allowed_ciphers = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.tls_cafile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.tls_certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.tls_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.tls_keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cache.username = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] coordination.backend_url = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.asyncio_connection = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.asyncio_slave_connection = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.backend = sqlalchemy {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.connection = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.connection_debug = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.connection_parameters = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.connection_recycle_time = 3600 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.connection_trace = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.db_inc_retry_interval = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.db_max_retries = 20 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.db_max_retry_interval = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.db_retry_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.max_overflow = 50 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.max_pool_size = 5 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.max_retries = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.mysql_wsrep_sync_wait = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.pool_timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.retry_interval = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.slave_connection = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.sqlite_synchronous = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.synchronous_reader = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] database.use_db_reconnect = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.connection_string = messaging:// {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.es_doc_type = notification {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.es_scroll_size = 10000 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.es_scroll_time = 2m {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.filter_error_trace = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.hmac_keys = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.sentinel_service_name = mymaster {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.socket_timeout = 0.1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.trace_requests = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler.trace_sqlalchemy = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler_jaeger.process_tags = {} {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler_jaeger.service_name_prefix = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] profiler_otlp.service_name_prefix = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.enforce_new_defaults = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 22:19:04 devstack cinder-volume[81722]: WARNING oslo_config.cfg [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.enforce_scope = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.policy_default_rule = default {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.policy_file = policy.yaml {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_policy.remote_timeout = 60.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] privsep_osbrick.group = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] privsep_osbrick.helper_command = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] privsep_osbrick.user = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_sys_admin.group = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_sys_admin.helper_command = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] cinder_sys_admin.user = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.auth_section = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.auth_type = password {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.cafile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.collect_timing = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.insecure = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.send_service_user_token = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.split_loggers = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] service_user.timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.auth_section = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.auth_type = password {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.collect_timing = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.insecure = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.region_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.split_loggers = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] glance.timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.backend_availability_zone = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.chap_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.chap_username = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.disk_geometry = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.driver_client_cert = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.driver_client_cert_key = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.driver_data_namespace = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.driver_use_ssl = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.enable_unsupported_driver = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.extra_capabilities = {} {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.filter_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.goodness_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.iscsi_target_flags = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.iscsi_write_cache = on {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.iser_helper = tgtadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.iser_port = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_host = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_login = admin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_mount_options = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_private_key = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_share_path = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_ssh_port = 22 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.num_shell_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.nvmet_port_id = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.quobyte_client_cfg = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81921) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.quobyte_volume_url = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.replication_device = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.report_discard_supported = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.reserved_percentage = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.scst_target_driver = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.scst_target_iqn_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.storage_protocol = iSCSI {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.target_helper = tgtadm {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.target_port = 3260 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.target_protocol = iscsi {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.trace_flags = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.unique_fqdn_network = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.use_chap_auth = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_backend_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_clear = zero {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_clear_ionice = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_clear_size = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_reports.file_event_handler = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_reports.log_dir = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.backend_availability_zone = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.backend_host = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.chap_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.chap_username = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.chiscsi_conf = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.disk_geometry = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.driver_client_cert = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.driver_client_cert_key = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.driver_data_namespace = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.driver_use_ssl = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.extra_capabilities = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.filter_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.goodness_function = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.iscsi_target_flags = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.iscsi_write_cache = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.iser_helper = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.iser_ip_address = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.iser_port = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.iser_target_prefix = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_host = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_login = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_mount_options = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_password = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_private_key = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_share_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_ssh_port = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.num_shell_tries = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nvmet_ns_id = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.nvmet_port_id = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.replication_device = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.report_discard_supported = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.reserved_percentage = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.scst_target_driver = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.storage_protocol = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.target_helper = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.target_ip_address = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.target_port = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.target_prefix = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.target_protocol = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.trace_flags = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.unique_fqdn_network = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.use_chap_auth = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_clear = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_clear_ionice = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_clear_size = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] QuobyteHD.volumes_dir = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.ssl = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.ssl_version = {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_notifications.driver = [] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_notifications.retry = -1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] oslo_messaging_notifications.transport_url = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] key_manager.fixed_key = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.barbican_api_version = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.barbican_endpoint = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.barbican_endpoint_type = public {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.barbican_region_name = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.cafile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.collect_timing = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.insecure = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.number_of_retries = 60 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.retry_delay = 1 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.send_service_user_token = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.split_loggers = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.verify_ssl = True {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican.verify_ssl_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.auth_section = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.auth_type = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.cafile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.certfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.collect_timing = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.insecure = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.keyfile = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.split_loggers = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] barbican_service_user.timeout = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.approle_role_id = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.approle_secret_id = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.kv_mountpoint = secret {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.kv_path = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.kv_version = 2 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.namespace = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.root_token_id = **** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.ssl_ca_crt_file = None {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.timeout = 60.0 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.use_ssl = False {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 22:19:04 devstack cinder-volume[81722]: DEBUG oslo_service.backend._eventlet.service [None req-c815f074-9224-41e6-8b25-a6d7e39c57ec None None] ******************************************************************************** {{(pid=81722) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81921) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 22:19:04 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 22:19:04 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Running cmd (subprocess): mount.quobyte {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:19:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:19:04 devstack sudo[81942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:19:04 devstack sudo[81942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:19:05 devstack sudo[81942]: pam_unix(sudo:session): session closed for user root Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.572s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:19:05 devstack cinder-volume[81921]: INFO cinder.volume.driver [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.volume.driver [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.673397064209, 'free_capacity_gb': 1775.673397064209, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81921) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_db.sqlalchemy.engines [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81921) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writer thread running {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.db.sqlalchemy.api [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Building query based on filter {{(pid=81921) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81921) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:19:05 devstack cinder-volume[81921]: INFO cinder.keymgr.migration [None req-165feb97-5cfc-4f4a-8e2c-a765752a49a3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 22:19:05 devstack sudo[81960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:19:05 devstack sudo[81960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:19:05 devstack sudo[81960]: pam_unix(sudo:session): session closed for user root Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.442s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:19:05 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Driver initialization completed successfully. Apr 15 22:19:05 devstack cinder-volume[81921]: INFO cinder.manager [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Initiating service 3 cleanup Apr 15 22:19:05 devstack cinder-volume[81921]: INFO cinder.manager [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Service 3 cleanup completed. Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.service [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Creating RPC server for service cinder-volume {{(pid=81921) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.service [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81921) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 22:19:05 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:19:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:19:05 devstack sudo[81969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:19:05 devstack sudo[81969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:19:06 devstack sudo[81969]: pam_unix(sudo:session): session closed for user root Apr 15 22:19:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:19:06 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9b0bda2b-644b-451e-8849-52df0bcf9b13 None None] Driver post RPC initialization completed successfully. Apr 15 22:19:14 devstack cinder-volume[81722]: DEBUG dbcounter [-] [81722] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81722) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:19:15 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=1 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:19:16 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Flow 'volume_create_manager' (cabc0dfc-01d5-40b0-9b8d-8b3f1be66c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe548d79-c2a4-4741-9edc-b215d8bfa7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe548d79-c2a4-4741-9edc-b215d8bfa7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-5902212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e809202e-7c6b-4bb7-9e5c-0786ec83d355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73421f94c27472696c355df58174141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:07Z,use_quota=True,user_id='ac50bcaf7a8d45d6a1b8e7103d53339a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f540a92c-65f5-49ca-85e8-d6fe3ace019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f540a92c-65f5-49ca-85e8-d6fe3ace019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5564c6e0-652b-433f-8c9a-2896952034fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5564c6e0-652b-433f-8c9a-2896952034fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e809202e-7c6b-4bb7-9e5c-0786ec83d355', 'volume_name': 'volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792a40a-e587-46fb-b755-98404acc22e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8792a40a-e587-46fb-b755-98404acc22e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd5457c-219c-433f-978e-c4a6b4c0fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:07 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Volume e809202e-7c6b-4bb7-9e5c-0786ec83d355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355', 'volume_size': 1} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-5902212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e809202e-7c6b-4bb7-9e5c-0786ec83d355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73421f94c27472696c355df58174141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:07Z,use_quota=True,user_id='ac50bcaf7a8d45d6a1b8e7103d53339a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Creating volume e809202e-7c6b-4bb7-9e5c-0786ec83d355 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:07 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:07 devstack sudo[82560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 1073741824 Apr 15 22:20:07 devstack sudo[82560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:07 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2f4caf0b-0d45-42dd-aebb-b98b10dcee04 tempest-GroupSnapshotsTest-475062089 None] Group tempest-GroupSnapshotsTest-Group-1398170090: creating Apr 15 22:20:07 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2f4caf0b-0d45-42dd-aebb-b98b10dcee04 tempest-GroupSnapshotsTest-475062089 None] Group tempest-GroupSnapshotsTest-Group-1398170090: created successfully Apr 15 22:20:07 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2f4caf0b-0d45-42dd-aebb-b98b10dcee04 tempest-GroupSnapshotsTest-475062089 None] Create group completed successfully. Apr 15 22:20:07 devstack sudo[82560]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 1073741824" returned: 0 in 0.569s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:07 devstack sudo[82878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 Apr 15 22:20:07 devstack sudo[82878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:08 devstack sudo[82878]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355" returned: 0 in 0.563s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd5457c-219c-433f-978e-c4a6b4c0fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ab1827-b505-4a1c-b10c-4ec080219c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:08 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Volume volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 (e809202e-7c6b-4bb7-9e5c-0786ec83d355): created successfully Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75ab1827-b505-4a1c-b10c-4ec080219c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Flow 'volume_create_manager' (cabc0dfc-01d5-40b0-9b8d-8b3f1be66c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9bd0faca-e8c1-49f2-b482-503d67a8b29a tempest-VolumesAdminNegativeTest-1322375647 None] Created volume successfully. Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (ec6d4ca2-78e6-4010-9e2e-1073ee9fe453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d571da-6cfb-44e2-b725-52ca336d7896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d571da-6cfb-44e2-b725-52ca336d7896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1759229726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7668eba9-af3e-4880-9e5d-eb2bfe4ef5b2,host='devstack@QuobyteHD#QuobyteHD',id=844c333f-aa9b-423c-ab96-0af5c3e9ffc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:09Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0f2ede7-6347-4719-b016-a6bcc8c40a9b),volume_type_id=d0f2ede7-6347-4719-b016-a6bcc8c40a9b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64abf9b0-98bd-420a-a3fe-1d84446a3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64abf9b0-98bd-420a-a3fe-1d84446a3b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fba6a40-a189-4bd4-a345-288260881033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fba6a40-a189-4bd4-a345-288260881033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '844c333f-aa9b-423c-ab96-0af5c3e9ffc2', 'volume_name': 'volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f2d1ec-f995-4922-885b-bd687cc044a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99f2d1ec-f995-4922-885b-bd687cc044a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5624f7-c012-4fc8-8017-7015a4f20714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:08 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Volume 844c333f-aa9b-423c-ab96-0af5c3e9ffc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2', 'volume_size': 1} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7668eba9-af3e-4880-9e5d-eb2bfe4ef5b2,created_at=2026-04-15T20:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1759229726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7668eba9-af3e-4880-9e5d-eb2bfe4ef5b2,host='devstack@QuobyteHD#QuobyteHD',id=844c333f-aa9b-423c-ab96-0af5c3e9ffc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:09Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0f2ede7-6347-4719-b016-a6bcc8c40a9b),volume_type_id=d0f2ede7-6347-4719-b016-a6bcc8c40a9b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Creating volume 844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:08 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:20:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:08 devstack sudo[82881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 1073741824 Apr 15 22:20:08 devstack sudo[82881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:09 devstack sudo[82881]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 1073741824" returned: 0 in 0.665s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:09 devstack sudo[82886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 Apr 15 22:20:09 devstack sudo[82886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Acquiring lock "cinder-e809202e-7c6b-4bb7-9e5c-0786ec83d355-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "cinder-e809202e-7c6b-4bb7-9e5c-0786ec83d355-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Acquiring lock "cinder-quobyte-e809202e-7c6b-4bb7-9e5c-0786ec83d355" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "cinder-quobyte-e809202e-7c6b-4bb7-9e5c-0786ec83d355" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:09 devstack cinder-volume[81921]: INFO oslo.privsep.daemon [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4_u9zj2x/privsep.sock'] Apr 15 22:20:09 devstack sudo[82888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4_u9zj2x/privsep.sock Apr 15 22:20:09 devstack sudo[82888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:10 devstack sudo[82886]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5624f7-c012-4fc8-8017-7015a4f20714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9528a0b-5cc2-44c2-9249-1c9a8b310791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Volume volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 (844c333f-aa9b-423c-ab96-0af5c3e9ffc2): created successfully Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9528a0b-5cc2-44c2-9249-1c9a8b310791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (ec6d4ca2-78e6-4010-9e2e-1073ee9fe453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:10 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fdf0a6e4-1afc-40c6-be2f-ca99c1189a8b tempest-GroupSnapshotsTest-475062089 None] Created volume successfully. Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 22:20:10 devstack cinder-volume[81921]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 22:20:10 devstack sudo[82888]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:10 devstack cinder-volume[81921]: INFO oslo.privsep.daemon [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Spawned new privsep daemon via rootwrap Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Accepted privsep connection to /tmp/tmp4_u9zj2x/privsep.sock {{(pid=81921) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 22:20:10 devstack cinder-volume[81921]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 22:20:10 devstack cinder-volume[81921]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 22:20:10 devstack cinder-volume[81921]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 22:20:10 devstack cinder-volume[81921]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82892 Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[34147918-b4a0-4e0b-8fdf-e59188ac523e]: (2,) {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c177aa3-5805-4742-b15c-115f15565c21]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:11 devstack sudo[82894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 Apr 15 22:20:11 devstack sudo[82894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:11 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] GroupSnapshot 50c67d41-054d-405f-b6e0-47858ce6187b: creating. Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Group snapshot 50c67d41-054d-405f-b6e0-47858ce6187b: creating. {{(pid=81921) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Creating offline snapshot 239ccb82-2c58-44c2-af67-bd013ff4d521 of volume 844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a26ed7-05a8-46f2-818c-450166766dc4]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:11 devstack sudo[82905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 Apr 15 22:20:11 devstack sudo[82905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:11 devstack sudo[82894]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355" returned: 0 in 0.633s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:11 devstack sudo[82907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355 Apr 15 22:20:11 devstack sudo[82907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:12 devstack sudo[82905]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" returned: 0 in 0.834s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:12 devstack sudo[82916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 1G Apr 15 22:20:12 devstack sudo[82916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:12 devstack sudo[82907]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e809202e-7c6b-4bb7-9e5c-0786ec83d355" returned: 0 in 0.934s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "cinder-quobyte-e809202e-7c6b-4bb7-9e5c-0786ec83d355" released by "delete_volume" :: held 2.725s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:12 devstack cinder-volume[81921]: WARNING cinder.quota [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:20:12 devstack cinder-volume[81921]: WARNING cinder.quota [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Created reservations ['11fdb8ef-bfee-4ee5-9fb3-cf67599e8ffd', '957b8f96-061f-4a5d-a4c4-0b21da387391', 'dd90877a-e4e0-4bf7-b3e9-059a86bb983d', '85d1588c-fe93-41ca-b478-7f2bd853a710'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:12 devstack sudo[82921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:20:12 devstack sudo[82921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:13 devstack sudo[82916]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 1G" returned: 0 in 1.008s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:13 devstack sudo[82927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 Apr 15 22:20:13 devstack sudo[82927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:13 devstack sudo[82921]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.987s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:13 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:20:13 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Deleted volume successfully. Apr 15 22:20:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b922f0f6-1ecf-40b1-838b-22a621a5e07a tempest-VolumesAdminNegativeTest-1322375647 None] Lock "cinder-e809202e-7c6b-4bb7-9e5c-0786ec83d355-delete_volume" released by "delete_volume" :: held 4.081s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:14 devstack sudo[82927]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521" returned: 0 in 0.853s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:14 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:20:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:14 devstack sudo[82939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 Apr 15 22:20:14 devstack sudo[82939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:14 devstack sudo[82939]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521" returned: 0 in 0.753s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:15 devstack sudo[82963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.info Apr 15 22:20:15 devstack sudo[82963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:16 devstack sudo[82963]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.info" returned: 0 in 1.005s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:16 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:20:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:16 devstack sudo[82969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.info Apr 15 22:20:16 devstack sudo[82969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:16 devstack sudo[82969]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.info" returned: 0 in 0.754s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.335s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-389bac11-566c-4ee0-b173-9563e1c1bac8 tempest-GroupSnapshotsTest-475062089 None] group_snapshot 50c67d41-054d-405f-b6e0-47858ce6187b: created successfully Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:17 devstack sudo[82974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:20:17 devstack sudo[82974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Flow 'volume_create_manager' (b5bba432-9b32-494b-bfde-dfe9c9406047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f9f7ea-0bdf-49f6-bb32-6b5d0cd72802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f9f7ea-0bdf-49f6-bb32-6b5d0cd72802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-440600131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2512940-a4c0-4e31-9a7b-28d9f847d023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbf56a05d9c843aaaf66f3d0c4e68dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:17Z,use_quota=True,user_id='defcdd28eb204f1cb583aa893cf4654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e9aad4-e05a-4165-960a-d8f677a6c56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e9aad4-e05a-4165-960a-d8f677a6c56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294d0788-f82a-4afb-be66-673b9afee45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294d0788-f82a-4afb-be66-673b9afee45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2512940-a4c0-4e31-9a7b-28d9f847d023', 'volume_name': 'volume-b2512940-a4c0-4e31-9a7b-28d9f847d023', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a082ead4-a8b7-4fd3-8e07-b07f1f4c99af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a082ead4-a8b7-4fd3-8e07-b07f1f4c99af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fab8d6-a9e1-49bd-9a49-4ee9fa70def8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:17 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Volume b2512940-a4c0-4e31-9a7b-28d9f847d023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2512940-a4c0-4e31-9a7b-28d9f847d023', 'volume_size': 1} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-440600131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2512940-a4c0-4e31-9a7b-28d9f847d023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbf56a05d9c843aaaf66f3d0c4e68dbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:17Z,use_quota=True,user_id='defcdd28eb204f1cb583aa893cf4654d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Creating volume b2512940-a4c0-4e31-9a7b-28d9f847d023 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:17 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:20:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:17 devstack sudo[82979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 1073741824 Apr 15 22:20:17 devstack sudo[82979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:18 devstack sudo[82974]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 1.054s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:18 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:20:18 devstack sudo[82979]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 1073741824" returned: 0 in 1.235s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:18 devstack sudo[82986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 Apr 15 22:20:18 devstack sudo[82986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:19 devstack sudo[82986]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023" returned: 0 in 0.823s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38fab8d6-a9e1-49bd-9a49-4ee9fa70def8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2512940-a4c0-4e31-9a7b-28d9f847d023', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebba2d87-6b76-455e-a064-8e16b56421f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-239ccb82-2c58-44c2-af67-bd013ff4d521-fafce3b4-6e0a-4585-8649-368ff918aef2" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:19 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Volume volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 (b2512940-a4c0-4e31-9a7b-28d9f847d023): created successfully Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebba2d87-6b76-455e-a064-8e16b56421f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Flow 'volume_create_manager' (b5bba432-9b32-494b-bfde-dfe9c9406047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:19 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9a8ec6c4-b7ca-4342-afc7-0d58add08cb2 tempest-DeleteServersTestJSON-1925510215 None] Created volume successfully. Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-239ccb82-2c58-44c2-af67-bd013ff4d521-fafce3b4-6e0a-4585-8649-368ff918aef2" acquired by "_create_volume_from_snapshot" :: waited 0.057s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Creating volume fafce3b4-6e0a-4585-8649-368ff918aef2 from snapshot 239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-fafce3b4-6e0a-4585-8649-368ff918aef2" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-fafce3b4-6e0a-4585-8649-368ff918aef2" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] snapshot: 239ccb82-2c58-44c2-af67-bd013ff4d521, volume: fafce3b4-6e0a-4585-8649-368ff918aef2, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[485ae980-0ed6-44f5-a558-bd9775a7de8c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:20 devstack sudo[82990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 Apr 15 22:20:20 devstack sudo[82990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:20 devstack sudo[82990]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521" returned: 0 in 0.484s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdcf38b-5895-4f92-93ec-855bfa21c4da]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:20 devstack sudo[82995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 Apr 15 22:20:20 devstack sudo[82995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:21 devstack sudo[82995]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" returned: 0 in 0.954s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:21 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:20:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:21 devstack sudo[83031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 Apr 15 22:20:21 devstack sudo[83031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:25 devstack sudo[83031]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2" returned: 0 in 3.916s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:25 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec1a00-93f1-4e9a-8dd4-a0249e6e9b0d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:25 devstack sudo[83070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 Apr 15 22:20:25 devstack sudo[83070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:26 devstack sudo[83070]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" returned: 0 in 1.307s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:26 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:20:26 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Converted 1024.00 MB image at 261.39 MB/s Apr 15 22:20:26 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:20:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:26 devstack sudo[83078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 Apr 15 22:20:26 devstack sudo[83078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:27 devstack cinder-volume[81921]: WARNING py.warnings [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 15 22:20:27 devstack cinder-volume[81921]: .first() Apr 15 22:20:27 devstack cinder-volume[81921]: Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:27 devstack sudo[83078]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2" returned: 0 in 0.946s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-fafce3b4-6e0a-4585-8649-368ff918aef2" released by "_copy_volume_from_snapshot" :: held 7.699s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-239ccb82-2c58-44c2-af67-bd013ff4d521-fafce3b4-6e0a-4585-8649-368ff918aef2" released by "_create_volume_from_snapshot" :: held 7.741s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.800s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.293s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c77d811-e0f1-49fa-b36c-cae995cfb406]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:28 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6aaf38ac-002c-4ffa-b8d8-96883d8f97a2 tempest-GroupSnapshotsTest-475062089 None] Create group from source-snapshot-50c67d41-054d-405f-b6e0-47858ce6187b completed successfully. Apr 15 22:20:28 devstack sudo[83121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 Apr 15 22:20:28 devstack sudo[83121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:29 devstack sudo[83121]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023" returned: 0 in 1.453s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.562s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6', 'name': 'volume-b2512940-a4c0-4e31-9a7b-28d9f847d023', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e935864-2ba6-4a54-bb51-8d3204a357ce', 'enforce_multipath': True} {{(pid=81921) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 22:20:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-fafce3b4-6e0a-4585-8649-368ff918aef2" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-fafce3b4-6e0a-4585-8649-368ff918aef2" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:29 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-4f1981ab-5137-407a-9089-a303f9c95964 req-386de17a-50fe-4d17-919f-03e7e8d0270b tempest-DeleteServersTestJSON-1925510215 None] attachment_update completed successfully. Apr 15 22:20:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b01dc26-2754-467c-a351-97fd7e7ff187]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:29 devstack sudo[83127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 Apr 15 22:20:29 devstack sudo[83127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:30 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:30 devstack sudo[83127]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Flow 'volume_create_manager' (7f68c62e-807e-40c1-a31d-2c8a11d91cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca01f620-addc-4fc8-bddb-77ebfb7fc755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca01f620-addc-4fc8-bddb-77ebfb7fc755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1897810889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8adcdd-ab04-4dca-b7ee-693a5c9262dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643885afc5df4cb6aae23e7fc832fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:31Z,use_quota=True,user_id='a25e2f67a9374aa584de54c272cf4587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b159562-939c-4919-a35e-0ac3ee79bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b159562-939c-4919-a35e-0ac3ee79bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39516059-a948-4f14-95a6-689777c47155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39516059-a948-4f14-95a6-689777c47155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8adcdd-ab04-4dca-b7ee-693a5c9262dc', 'volume_name': 'volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159aa9cb-d2b0-48b6-9ba0-396dd06428d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (159aa9cb-d2b0-48b6-9ba0-396dd06428d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd417e2-0e3a-4dbf-9015-5e9cd483d908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:31 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Volume ec8adcdd-ab04-4dca-b7ee-693a5c9262dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc', 'volume_size': 1} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1897810889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec8adcdd-ab04-4dca-b7ee-693a5c9262dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643885afc5df4cb6aae23e7fc832fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:31Z,use_quota=True,user_id='a25e2f67a9374aa584de54c272cf4587',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Creating volume ec8adcdd-ab04-4dca-b7ee-693a5c9262dc {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:31 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2" returned: 0 in 1.600s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:31 devstack sudo[83517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2 Apr 15 22:20:31 devstack sudo[83517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:31 devstack sudo[83516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc 1073741824 Apr 15 22:20:31 devstack sudo[83516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:31 devstack sudo[83517]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fafce3b4-6e0a-4585-8649-368ff918aef2" returned: 0 in 0.687s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-fafce3b4-6e0a-4585-8649-368ff918aef2" released by "delete_volume" :: held 2.407s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Created reservations ['67bdf2da-c158-4bf5-a297-d15504579fac'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:31 devstack cinder-volume[81921]: WARNING cinder.quota [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-670543147 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-670543147, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:20:31 devstack cinder-volume[81921]: WARNING cinder.quota [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-670543147 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-670543147, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:20:31 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Created reservations ['7311bc16-0b7b-48ff-9d25-aa39d5a88249', '4ec365b4-9319-423f-9b38-8ddcc795da93', 'e8d04e69-de68-4b47-9517-75935bc5a0aa', '8dbd7808-f840-4334-abd5-91a9c21a6b27'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:32 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:20:32 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:32 devstack sudo[83516]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc 1073741824" returned: 0 in 1.255s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:32 devstack sudo[83531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc Apr 15 22:20:32 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] group_snapshot 50c67d41-054d-405f-b6e0-47858ce6187b: deleting Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] group_snapshot 50c67d41-054d-405f-b6e0-47858ce6187b: deleting {{(pid=81921) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 22:20:33 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 1.136s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:20:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e49be305-e448-474d-a6e1-e8966647dd7a tempest-GroupSnapshotsTest-475062089 None] Delete group completed successfully. Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-239ccb82-2c58-44c2-af67-bd013ff4d521" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-239ccb82-2c58-44c2-af67-bd013ff4d521" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Deleting offline snapshot 239ccb82-2c58-44c2-af67-bd013ff4d521 of volume 844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] snapshot_file for this snap is: volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0887f046-ecd1-4c32-a431-2e7b1b70751f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:33 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc" returned: 0 in 1.181s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] <== create_volume: return (2491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.495s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd417e2-0e3a-4dbf-9015-5e9cd483d908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1f2b6c-81bc-4ccf-9fd0-060880fd6630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:33 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Volume volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc (ec8adcdd-ab04-4dca-b7ee-693a5c9262dc): created successfully Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e1f2b6c-81bc-4ccf-9fd0-060880fd6630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Flow 'volume_create_manager' (7f68c62e-807e-40c1-a31d-2c8a11d91cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2dca5d4e-5704-466e-8b0c-02306c9c1451 tempest-ServerRescueNegativeTestJSON-1380712799 None] Created volume successfully. Apr 15 22:20:33 devstack sudo[83536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 Apr 15 22:20:33 devstack sudo[83536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:34 devstack sudo[83536]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521" returned: 0 in 1.073s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:20:34 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[77548818-aba2-4978-abe2-a7b6d11c1d65]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:34 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 Apr 15 22:20:34 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:35 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" returned: 0 in 1.316s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:36 devstack sudo[83549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 Apr 15 22:20:36 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:37 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521" returned: 0 in 1.198s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:37 devstack sudo[83579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521 Apr 15 22:20:37 devstack sudo[83579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:37 devstack sudo[83579]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2.239ccb82-2c58-44c2-af67-bd013ff4d521" returned: 0 in 0.776s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-239ccb82-2c58-44c2-af67-bd013ff4d521" released by "_delete_snapshot" :: held 4.624s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" released by "delete_snapshot" :: held 4.650s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:38 devstack cinder-volume[81921]: WARNING cinder.quota [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-670543147 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-670543147, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:20:38 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['b9e528a2-6c4f-4335-8147-fea6f60f5a5c', '5a4edd27-1642-4261-8a05-8603d9a8da2f', '07794e36-efc8-4650-a286-e87018f4c98d', '779eec3d-6971-4af8-8826-977f34a6379b'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-08f52fb3-395f-433e-b3ca-6fc2eca32cf7 tempest-GroupSnapshotsTest-475062089 None] group_snapshot 50c67d41-054d-405f-b6e0-47858ce6187b: deleted successfully Apr 15 22:20:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:39 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c434f4ad-5e2b-4925-ad1a-4994cafda30a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:39 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 Apr 15 22:20:39 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:39 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" returned: 0 in 0.750s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:39 devstack sudo[83649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2 Apr 15 22:20:39 devstack sudo[83649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-bbd6380c-a767-4fd2-bcf9-09599892847e req-41caec40-3c5d-48e3-b51e-feaf27021ac5 tempest-DeleteServersTestJSON-1925510215 None] Terminate volume connection completed successfully. Apr 15 22:20:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-bbd6380c-a767-4fd2-bcf9-09599892847e req-41caec40-3c5d-48e3-b51e-feaf27021ac5 tempest-DeleteServersTestJSON-1925510215 None] Deleting attachment 4e935864-2ba6-4a54-bb51-8d3204a357ce. {{(pid=81921) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 22:20:40 devstack sudo[83649]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" returned: 0 in 0.597s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-844c333f-aa9b-423c-ab96-0af5c3e9ffc2" released by "delete_volume" :: held 1.430s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['e0147635-7ba9-45f5-b4df-e68e9c7302bb'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:40 devstack cinder-volume[81921]: WARNING cinder.db.sqlalchemy.api [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-670543147'] Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['aa1fcc72-8716-4326-aa3f-451c6fee715b', 'd7919baa-4caf-424f-a5c5-3e577a3de81e', '60e4f98b-7f10-43b7-ae85-34ca6ad0ec8c', 'c2dd3ad0-723e-49fb-a10d-931b5bea40b3'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:40 devstack sudo[83653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:20:40 devstack sudo[83653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:41 devstack sudo[83653]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.523s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:41 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:20:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-57c2b822-569f-4e86-82ee-9087c96cf7f2 tempest-GroupSnapshotsTest-475062089 None] Delete group completed successfully. Apr 15 22:20:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-46a59fe7-711b-418b-a99f-8e769152d97d tempest-GroupSnapshotsTest-475062089 None] Group tempest-GroupSnapshotsTest-Group-99286859: creating Apr 15 22:20:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-46a59fe7-711b-418b-a99f-8e769152d97d tempest-GroupSnapshotsTest-475062089 None] Group tempest-GroupSnapshotsTest-Group-99286859: created successfully Apr 15 22:20:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-46a59fe7-711b-418b-a99f-8e769152d97d tempest-GroupSnapshotsTest-475062089 None] Create group completed successfully. Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (661dc4a4-c5f8-4059-9ea0-75baf1e212f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fc394a-4d76-4914-b588-b4cb6b3b5c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4fc394a-4d76-4914-b588-b4cb6b3b5c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039920271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e359a8b2-5005-4aab-bb46-ad23278943a4,host='devstack@QuobyteHD#QuobyteHD',id=8c19f747-c533-46b6-bb9f-42d21e1c6a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:43Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdb4bd19-eb63-478c-9ef4-b00afe827340),volume_type_id=bdb4bd19-eb63-478c-9ef4-b00afe827340)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a2db6d-db90-4701-a18e-19d74cc2d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a2db6d-db90-4701-a18e-19d74cc2d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff280c5b-1c28-439c-92fa-8dedc29f4813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff280c5b-1c28-439c-92fa-8dedc29f4813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c19f747-c533-46b6-bb9f-42d21e1c6a67', 'volume_name': 'volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5742617-698f-4648-a2f6-451f4367373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5742617-698f-4648-a2f6-451f4367373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25463f1-85f5-48c8-8b6c-3e59d550566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:43 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Volume 8c19f747-c533-46b6-bb9f-42d21e1c6a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67', 'volume_size': 1} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e359a8b2-5005-4aab-bb46-ad23278943a4,created_at=2026-04-15T20:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039920271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e359a8b2-5005-4aab-bb46-ad23278943a4,host='devstack@QuobyteHD#QuobyteHD',id=8c19f747-c533-46b6-bb9f-42d21e1c6a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:43Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdb4bd19-eb63-478c-9ef4-b00afe827340),volume_type_id=bdb4bd19-eb63-478c-9ef4-b00afe827340)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Creating volume 8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:43 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:20:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:43 devstack sudo[83659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 1073741824 Apr 15 22:20:43 devstack sudo[83659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Acquiring lock "cinder-b2512940-a4c0-4e31-9a7b-28d9f847d023-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Lock "cinder-b2512940-a4c0-4e31-9a7b-28d9f847d023-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Acquiring lock "cinder-quobyte-b2512940-a4c0-4e31-9a7b-28d9f847d023" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Lock "cinder-quobyte-b2512940-a4c0-4e31-9a7b-28d9f847d023" acquired by "delete_volume" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9a30bc-2edd-4d23-8503-0cbb2d81683d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:44 devstack sudo[83694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 Apr 15 22:20:44 devstack sudo[83694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:44 devstack sudo[83659]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 1073741824" returned: 0 in 1.223s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:44 devstack sudo[83696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 Apr 15 22:20:44 devstack sudo[83696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Flow 'volume_create_manager' (a9bcac1c-b5e0-49c9-8914-1dd286e31ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0120fd3a-6823-437b-802a-30c747a1c895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0120fd3a-6823-437b-802a-30c747a1c895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2139039579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f037a0-80a4-4e94-93ca-73b3c4ec569a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31790b753593452fb899ad9991e8ea91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:45Z,use_quota=True,user_id='63e7bd21ecb64555a5facbd6dab1a781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885efec7-1886-4df0-b00d-238db6538a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885efec7-1886-4df0-b00d-238db6538a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04df435f-2493-4b59-9c55-f7841592c381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04df435f-2493-4b59-9c55-f7841592c381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5f037a0-80a4-4e94-93ca-73b3c4ec569a', 'volume_name': 'volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9ea3fc-f6b0-4362-b5cc-fe7f47ddebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9ea3fc-f6b0-4362-b5cc-fe7f47ddebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78439799-f9ff-4501-b130-a30aad388817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:45 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Volume e5f037a0-80a4-4e94-93ca-73b3c4ec569a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a', 'volume_size': 1} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:45 devstack sudo[83696]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67" returned: 0 in 0.525s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.123s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2139039579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5f037a0-80a4-4e94-93ca-73b3c4ec569a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31790b753593452fb899ad9991e8ea91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:45Z,use_quota=True,user_id='63e7bd21ecb64555a5facbd6dab1a781',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Creating volume e5f037a0-80a4-4e94-93ca-73b3c4ec569a {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:45 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25463f1-85f5-48c8-8b6c-3e59d550566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a408e6eb-3fb1-419a-90cd-07e6f1d38588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:45 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Volume volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 (8c19f747-c533-46b6-bb9f-42d21e1c6a67): created successfully Apr 15 22:20:45 devstack sudo[83694]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:45 devstack sudo[83702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a 1073741824 Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a408e6eb-3fb1-419a-90cd-07e6f1d38588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:45 devstack sudo[83702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (661dc4a4-c5f8-4059-9ea0-75baf1e212f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023" returned: 0 in 0.778s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a3b3af3d-0ec9-4b4b-b7db-105fa5334753 tempest-GroupSnapshotsTest-475062089 None] Created volume successfully. Apr 15 22:20:45 devstack sudo[83704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023 Apr 15 22:20:45 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:45 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2512940-a4c0-4e31-9a7b-28d9f847d023" returned: 0 in 0.546s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Lock "cinder-quobyte-b2512940-a4c0-4e31-9a7b-28d9f847d023" released by "delete_volume" :: held 1.433s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Created reservations ['a3c152fa-8bfb-44c1-9bd6-158c64bd8b1e', '0f3bfba1-dcc7-4560-adad-a72d99a83510', '45450a3d-fdb8-42be-bbb1-e2ce0b200aba', '8d70b21a-5942-4b60-8796-85d9e9f94661'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:46 devstack sudo[83710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:20:46 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:46 devstack sudo[83702]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a 1073741824" returned: 0 in 0.968s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:46 devstack sudo[83713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a Apr 15 22:20:46 devstack sudo[83713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (2a08a32e-07ab-4854-81f5-a87828d9c261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb134313-7046-4e7b-a326-fca30d03eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb134313-7046-4e7b-a326-fca30d03eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274256827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e359a8b2-5005-4aab-bb46-ad23278943a4,host='devstack@QuobyteHD#QuobyteHD',id=7de851da-726b-4b48-a1e7-44552fb4b33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:47Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdb4bd19-eb63-478c-9ef4-b00afe827340),volume_type_id=bdb4bd19-eb63-478c-9ef4-b00afe827340)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c0e9d7-28cc-4018-a0d4-2cc188cf714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c0e9d7-28cc-4018-a0d4-2cc188cf714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f07bd6-ac9a-4d53-a343-ba5bdda3a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f07bd6-ac9a-4d53-a343-ba5bdda3a968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de851da-726b-4b48-a1e7-44552fb4b33e', 'volume_name': 'volume-7de851da-726b-4b48-a1e7-44552fb4b33e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119bf29a-d2e3-419f-aae0-6a8976d596e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119bf29a-d2e3-419f-aae0-6a8976d596e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e6b82f-8c41-492e-a070-3b02467ca7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:46 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Volume 7de851da-726b-4b48-a1e7-44552fb4b33e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de851da-726b-4b48-a1e7-44552fb4b33e', 'volume_size': 1} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:46 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.895s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:20:46 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Deleted volume successfully. Apr 15 22:20:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e53b8ae2-ef04-4ad8-9fd5-69b615725648 tempest-DeleteServersTestJSON-1925510215 None] Lock "cinder-b2512940-a4c0-4e31-9a7b-28d9f847d023-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:47 devstack sudo[83713]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a" returned: 0 in 0.890s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e359a8b2-5005-4aab-bb46-ad23278943a4,created_at=2026-04-15T20:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274256827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e359a8b2-5005-4aab-bb46-ad23278943a4,host='devstack@QuobyteHD#QuobyteHD',id=7de851da-726b-4b48-a1e7-44552fb4b33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:47Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdb4bd19-eb63-478c-9ef4-b00afe827340),volume_type_id=bdb4bd19-eb63-478c-9ef4-b00afe827340)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Creating volume 7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:20:47 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78439799-f9ff-4501-b130-a30aad388817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347b1bd1-8273-4d63-b4e3-260d6adab2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:47 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Volume volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a (e5f037a0-80a4-4e94-93ca-73b3c4ec569a): created successfully Apr 15 22:20:47 devstack sudo[83718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e 1073741824 Apr 15 22:20:47 devstack sudo[83718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347b1bd1-8273-4d63-b4e3-260d6adab2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Flow 'volume_create_manager' (a9bcac1c-b5e0-49c9-8914-1dd286e31ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:47 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-4facb201-e694-4dc6-9938-e7fef6a0b836 req-51492bab-16eb-4fc3-9f55-47670ce0a267 tempest-VolumesGetTestJSON-219737129 None] Created volume successfully. Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Acquiring lock "cinder-e5f037a0-80a4-4e94-93ca-73b3c4ec569a-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Lock "cinder-e5f037a0-80a4-4e94-93ca-73b3c4ec569a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Acquiring lock "cinder-quobyte-e5f037a0-80a4-4e94-93ca-73b3c4ec569a" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Lock "cinder-quobyte-e5f037a0-80a4-4e94-93ca-73b3c4ec569a" acquired by "delete_volume" :: waited 0.025s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d46af00-7163-4c22-9ab8-bf17af1ced9b]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:47 devstack sudo[83720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a Apr 15 22:20:47 devstack sudo[83720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:48 devstack sudo[83720]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a" returned: 0 in 0.731s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:48 devstack sudo[83728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a Apr 15 22:20:48 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:48 devstack sudo[83718]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e 1073741824" returned: 0 in 1.410s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:48 devstack sudo[83730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e Apr 15 22:20:48 devstack sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:49 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e5f037a0-80a4-4e94-93ca-73b3c4ec569a" returned: 0 in 0.704s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Lock "cinder-quobyte-e5f037a0-80a4-4e94-93ca-73b3c4ec569a" released by "delete_volume" :: held 1.472s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.quota [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Created reservations ['79f3f23b-6b64-439b-8681-bfdc2513fce5', 'e1e072d0-a919-4e8b-88e2-82b20439873e', '6ec3e334-9f25-4baf-b944-c0e707641e7b', 'c3d7b261-efe3-4af9-9cb5-ff3ede6da5d1'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:49 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:20:49 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:49 devstack sudo[83730]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e" returned: 0 in 1.026s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] <== create_volume: return (2468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.471s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e6b82f-8c41-492e-a070-3b02467ca7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de851da-726b-4b48-a1e7-44552fb4b33e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6595cfe0-850c-4464-b6fa-1f53de549734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:49 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Volume volume-7de851da-726b-4b48-a1e7-44552fb4b33e (7de851da-726b-4b48-a1e7-44552fb4b33e): created successfully Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6595cfe0-850c-4464-b6fa-1f53de549734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (2a08a32e-07ab-4854-81f5-a87828d9c261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:49 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-97bbf2ab-0d9e-4589-a9e6-0ac85ea347e1 tempest-GroupSnapshotsTest-475062089 None] Created volume successfully. Apr 15 22:20:49 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.642s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:49 devstack cinder-volume[81921]: DEBUG cinder.manager [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:20:49 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Deleted volume successfully. Apr 15 22:20:50 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-11827cfc-0033-4065-87a0-fa7b0c2643cb req-0d8f0c43-75cf-44b5-9990-d89fd6b58e1f tempest-VolumesGetTestJSON-219737129 None] Lock "cinder-e5f037a0-80a4-4e94-93ca-73b3c4ec569a-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:50 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6c50387b-9562-4625-a646-f27fdf3e0948 tempest-GroupSnapshotsTest-475062089 None] Update group completed successfully. Apr 15 22:20:51 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-04a39bcc-d05f-44c1-a0c1-6e89302a93db tempest-GroupSnapshotsTest-475062089 None] Update group completed successfully. Apr 15 22:20:52 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ad327d70-8949-40eb-9416-4a0f41546ed4 tempest-GroupSnapshotsTest-475062089 None] Update group completed successfully. Apr 15 22:20:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Acquiring lock "cinder-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "cinder-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Acquiring lock "cinder-quobyte-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:20:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "cinder-quobyte-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:20:53 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e04b43-bd4b-4967-96b8-0263212365a4]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:53 devstack sudo[83794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc Apr 15 22:20:53 devstack sudo[83794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f9861691-dd82-4260-a8eb-c017a77aa589 tempest-GroupsV314Test-829718327 None] Group tempest-GroupsV314Test-Group-703980763: creating Apr 15 22:20:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f9861691-dd82-4260-a8eb-c017a77aa589 tempest-GroupsV314Test-829718327 None] Group tempest-GroupsV314Test-Group-703980763: created successfully Apr 15 22:20:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f9861691-dd82-4260-a8eb-c017a77aa589 tempest-GroupsV314Test-829718327 None] Create group completed successfully. Apr 15 22:20:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b5f351ac-476d-4619-bc70-fae729ee8942 tempest-GroupSnapshotsTest-475062089 None] Update group completed successfully. Apr 15 22:20:54 devstack sudo[83794]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc" returned: 0 in 1.055s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:54 devstack sudo[83803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc Apr 15 22:20:54 devstack sudo[83803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:54 devstack sudo[83803]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc" returned: 0 in 0.448s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "cinder-quobyte-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc" released by "delete_volume" :: held 1.643s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:54 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Created reservations ['c2df4a8e-ae76-418c-8ffe-5ca2f7a3778d', 'bbeb515d-5744-41ad-a26f-36666362b89f', '89de7c14-51da-436b-a24f-029ef2a8fbe7', '0a070d84-0f67-4077-9965-f18eeb4f159d'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:55 devstack sudo[83817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:20:55 devstack sudo[83817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] GroupSnapshot d8eb2c44-6f06-4db9-983a-d7d52d653d28: creating. Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Group snapshot d8eb2c44-6f06-4db9-983a-d7d52d653d28: creating. {{(pid=81921) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Creating offline snapshot 30cb35fa-50c3-4a90-87da-c430d0038574 of volume 8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Flow 'volume_create_manager' (2e4833a1-502c-4070-943e-afa0e5837ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965b9ad5-b43f-4861-8c74-7802409e62da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a1faa-4e26-4dd3-9717-43019568a7dd]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965b9ad5-b43f-4861-8c74-7802409e62da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271120442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11b984b3-bd8a-4935-9bc9-cc51a64a507b,host='devstack@QuobyteHD#QuobyteHD',id=c8fe6839-094f-4c5b-b28b-54bca27e21f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ad05541714789bcf39e7e7197f6b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:56Z,use_quota=True,user_id='b3f367f6622c4216bfcf44ee39cb6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4218f939-8c48-4f8e-a507-2d8e8615a447),volume_type_id=4218f939-8c48-4f8e-a507-2d8e8615a447)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276de6e3-7f69-4561-9190-b95c658dd06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276de6e3-7f69-4561-9190-b95c658dd06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f952144-8924-4301-86f4-21470bebafe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f952144-8924-4301-86f4-21470bebafe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8fe6839-094f-4c5b-b28b-54bca27e21f5', 'volume_name': 'volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76c506d-1a7a-4a0a-a039-472749ca8bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76c506d-1a7a-4a0a-a039-472749ca8bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:20:55 devstack sudo[83817]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9302a6b-3747-469a-be7c-5ccffccb413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:20:55 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Volume c8fe6839-094f-4c5b-b28b-54bca27e21f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5', 'volume_size': 1} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.920s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:20:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Deleted volume successfully. Apr 15 22:20:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a53f4e31-f94b-4acd-b5b3-9329b02129fd tempest-ServerRescueNegativeTestJSON-1380712799 None] Lock "cinder-ec8adcdd-ab04-4dca-b7ee-693a5c9262dc-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:20:56 devstack sudo[83823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 Apr 15 22:20:56 devstack sudo[83823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:56 devstack sudo[83823]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67" returned: 0 in 0.707s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:56 devstack sudo[83841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 1G Apr 15 22:20:56 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:57 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 1G" returned: 0 in 0.636s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:57 devstack sudo[83871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 Apr 15 22:20:57 devstack sudo[83871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:57 devstack sudo[83871]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574" returned: 0 in 0.636s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:57 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:20:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:57 devstack sudo[83878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 Apr 15 22:20:57 devstack sudo[83878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:58 devstack sudo[83878]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574" returned: 0 in 0.450s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:58 devstack sudo[83882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.info Apr 15 22:20:58 devstack sudo[83882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:58 devstack sudo[83882]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.info" returned: 0 in 0.595s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:58 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:20:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:58 devstack sudo[83888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.info Apr 15 22:20:58 devstack sudo[83888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:20:59 devstack sudo[83888]: pam_unix(sudo:session): session closed for user root Apr 15 22:20:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.info" returned: 0 in 0.432s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:20:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.567s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:20:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:20:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:20:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Creating offline snapshot f2537c2b-3424-417b-9293-e6c9c8416994 of volume 7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:20:59 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[59788594-7803-424e-a334-7c587522e01e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:20:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:20:59 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e Apr 15 22:20:59 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:00 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e" returned: 0 in 0.637s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:00 devstack sudo[83897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 1G Apr 15 22:21:00 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:00 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 1G" returned: 0 in 0.648s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de851da-726b-4b48-a1e7-44552fb4b33e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:00 devstack sudo[83908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de851da-726b-4b48-a1e7-44552fb4b33e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 Apr 15 22:21:00 devstack sudo[83908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:01 devstack sudo[83908]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de851da-726b-4b48-a1e7-44552fb4b33e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994" returned: 0 in 0.550s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:01 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:01 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 Apr 15 22:21:01 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:01 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994" returned: 0 in 0.568s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:01 devstack sudo[83916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.info Apr 15 22:21:01 devstack sudo[83916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:02 devstack sudo[83916]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.info" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:02 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:02 devstack sudo[83921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.info Apr 15 22:21:02 devstack sudo[83921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:02 devstack sudo[83921]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.info" returned: 0 in 0.452s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.922s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=11b984b3-bd8a-4935-9bc9-cc51a64a507b,created_at=2026-04-15T20:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271120442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=11b984b3-bd8a-4935-9bc9-cc51a64a507b,host='devstack@QuobyteHD#QuobyteHD',id=c8fe6839-094f-4c5b-b28b-54bca27e21f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ad05541714789bcf39e7e7197f6b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:20:56Z,use_quota=True,user_id='b3f367f6622c4216bfcf44ee39cb6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4218f939-8c48-4f8e-a507-2d8e8615a447),volume_type_id=4218f939-8c48-4f8e-a507-2d8e8615a447)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Creating volume c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:02 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:02 devstack sudo[83932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 1073741824 Apr 15 22:21:02 devstack sudo[83932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:02 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2cc63226-fc55-4ae5-9ef6-ba8355c35ed5 tempest-GroupSnapshotsTest-475062089 None] group_snapshot d8eb2c44-6f06-4db9-983a-d7d52d653d28: created successfully Apr 15 22:21:03 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] group_snapshot d8eb2c44-6f06-4db9-983a-d7d52d653d28: deleting Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] group_snapshot d8eb2c44-6f06-4db9-983a-d7d52d653d28: deleting {{(pid=81921) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-8c19f747-c533-46b6-bb9f-42d21e1c6a67" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-8c19f747-c533-46b6-bb9f-42d21e1c6a67" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-30cb35fa-50c3-4a90-87da-c430d0038574" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-30cb35fa-50c3-4a90-87da-c430d0038574" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Deleting offline snapshot 30cb35fa-50c3-4a90-87da-c430d0038574 of volume 8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] snapshot_file for this snap is: volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[886f3520-263f-42fc-8f0c-ea8c62f1a216]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:03 devstack sudo[83953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 Apr 15 22:21:03 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:03 devstack sudo[83932]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 1073741824" returned: 0 in 0.726s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:03 devstack sudo[83956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 Apr 15 22:21:03 devstack sudo[83956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:04 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574" returned: 0 in 0.654s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c6daee-063a-47e0-8e3a-7c0eccf819ca]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:04 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 Apr 15 22:21:04 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:04 devstack sudo[83956]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5" returned: 0 in 0.650s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9302a6b-3747-469a-be7c-5ccffccb413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4c67f9-3e6e-430f-baa7-a841605edfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:04 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Volume volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 (c8fe6839-094f-4c5b-b28b-54bca27e21f5): created successfully Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4c67f9-3e6e-430f-baa7-a841605edfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Flow 'volume_create_manager' (2e4833a1-502c-4070-943e-afa0e5837ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1b3ac953-e259-4f6a-9543-bf87eda064b0 tempest-GroupsV314Test-829718327 None] Created volume successfully. Apr 15 22:21:04 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67" returned: 0 in 0.595s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:04 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 Apr 15 22:21:04 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:05 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574" returned: 0 in 0.599s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:05 devstack sudo[83974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574 Apr 15 22:21:05 devstack sudo[83974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:05 devstack sudo[83974]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=94,cinder:UPDATE=83,cinder:INSERT=27,cinder:DELETE=8 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67.30cb35fa-50c3-4a90-87da-c430d0038574" returned: 0 in 0.534s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:05 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Cloning volume c8fe6839-094f-4c5b-b28b-54bca27e21f5 to volume aad54d46-fa3a-406e-b926-dcdd6473c0aa Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Creating offline snapshot cb22a7b3-039d-46f9-8ff5-7f4040021cc7 of volume c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-30cb35fa-50c3-4a90-87da-c430d0038574" released by "_delete_snapshot" :: held 2.474s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3fda15-0ff3-40ac-94a7-72d62774594f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-8c19f747-c533-46b6-bb9f-42d21e1c6a67" released by "delete_snapshot" :: held 2.512s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-7de851da-726b-4b48-a1e7-44552fb4b33e" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-7de851da-726b-4b48-a1e7-44552fb4b33e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-f2537c2b-3424-417b-9293-e6c9c8416994" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-f2537c2b-3424-417b-9293-e6c9c8416994" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Deleting offline snapshot f2537c2b-3424-417b-9293-e6c9c8416994 of volume 7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] snapshot_file for this snap is: volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eeef9bd-b6d9-4cc5-ae12-5fbea8f45be5]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:05 devstack sudo[83982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 Apr 15 22:21:05 devstack sudo[83982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:06 devstack sudo[83983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 Apr 15 22:21:06 devstack sudo[83983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:06 devstack sudo[83982]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5" returned: 0 in 0.510s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:06 devstack sudo[83991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 1G Apr 15 22:21:06 devstack sudo[83991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:06 devstack sudo[83983]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994" returned: 0 in 0.561s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7de851da-726b-4b48-a1e7-44552fb4b33e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[00162e7a-58c9-43bb-9756-3aefd1c332ec]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:06 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e Apr 15 22:21:06 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:06 devstack sudo[83991]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 1G" returned: 0 in 0.582s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:06 devstack sudo[84038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 Apr 15 22:21:06 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:07 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e" returned: 0 in 0.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:07 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 Apr 15 22:21:07 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:07 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7" returned: 0 in 0.461s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:07 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:07 devstack sudo[84047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 Apr 15 22:21:07 devstack sudo[84047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:07 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:07 devstack sudo[84050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994 Apr 15 22:21:07 devstack sudo[84050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:07 devstack sudo[84047]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=117,cinder:UPDATE=115,cinder:INSERT=15,cinder:DELETE=4 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:07 devstack sudo[84054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.info Apr 15 22:21:07 devstack sudo[84054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:07 devstack sudo[84050]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e.f2537c2b-3424-417b-9293-e6c9c8416994" returned: 0 in 0.461s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-f2537c2b-3424-417b-9293-e6c9c8416994" released by "_delete_snapshot" :: held 2.095s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-7de851da-726b-4b48-a1e7-44552fb4b33e" released by "delete_snapshot" :: held 2.111s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:08 devstack cinder-volume[81921]: WARNING cinder.quota [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-459901331 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-459901331, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:08 devstack cinder-volume[81921]: WARNING cinder.quota [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-459901331 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-459901331, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Created reservations ['dacbe39c-b22b-4f9c-aaa8-6f892695e71c', '2fde7893-58c9-49d2-be89-da6bebceb797', 'fe909ede-aa4c-48ac-8a7c-ac421de8e09c', 'd503ac1c-e548-4cab-b3a8-13c1c8cd8fa9'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] Created reservations ['f480111a-f060-44a3-b475-57fb0ef2d570', 'c2ab87e1-67cb-419c-ab9a-af981e32eb19', 'b5f38aa4-9065-4b26-a6f9-1b8c31031d39', 'e95bac5a-303f-4da0-bbee-a8659a321fa9'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4e588029-12a0-4345-ac48-dfafe722340d tempest-GroupSnapshotsTest-475062089 None] group_snapshot d8eb2c44-6f06-4db9-983a-d7d52d653d28: deleted successfully Apr 15 22:21:08 devstack sudo[84054]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.info" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:08 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:08 devstack sudo[84057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.info Apr 15 22:21:08 devstack sudo[84057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:08 devstack sudo[84057]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.info" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Acquiring lock "cinder-quobyte-aad54d46-fa3a-406e-b926-dcdd6473c0aa" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-aad54d46-fa3a-406e-b926-dcdd6473c0aa" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] snapshot: cb22a7b3-039d-46f9-8ff5-7f4040021cc7, volume: aad54d46-fa3a-406e-b926-dcdd6473c0aa, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffa05d5-5bf6-4c70-8ec6-3432228139b7]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-7de851da-726b-4b48-a1e7-44552fb4b33e" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:08 devstack sudo[84060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 Apr 15 22:21:08 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-7de851da-726b-4b48-a1e7-44552fb4b33e" acquired by "delete_volume" :: waited 0.033s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6956d8-50a3-4c44-926e-0aad9e464780]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:09 devstack sudo[84062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e Apr 15 22:21:09 devstack sudo[84062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:09 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7" returned: 0 in 0.546s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[51185fbf-1f5e-4726-a6db-76c0fbccd743]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:09 devstack sudo[84067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 Apr 15 22:21:09 devstack sudo[84067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:09 devstack sudo[84062]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e" returned: 0 in 0.580s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:09 devstack sudo[84073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e Apr 15 22:21:09 devstack sudo[84073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:09 devstack sudo[84067]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5" returned: 0 in 0.515s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:21:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:09 devstack sudo[84079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa Apr 15 22:21:09 devstack sudo[84079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:10 devstack sudo[84073]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-7de851da-726b-4b48-a1e7-44552fb4b33e" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-7de851da-726b-4b48-a1e7-44552fb4b33e" released by "delete_volume" :: held 1.104s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-8c19f747-c533-46b6-bb9f-42d21e1c6a67" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-8c19f747-c533-46b6-bb9f-42d21e1c6a67" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[361b3ffa-c78d-46c9-91cf-66e7033b2eee]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:10 devstack sudo[84082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 Apr 15 22:21:10 devstack sudo[84082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:11 devstack sudo[84082]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67" returned: 0 in 1.017s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:11 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67 Apr 15 22:21:11 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:12 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8c19f747-c533-46b6-bb9f-42d21e1c6a67" returned: 0 in 1.096s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-8c19f747-c533-46b6-bb9f-42d21e1c6a67" released by "delete_volume" :: held 2.167s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['788029a8-0ce3-4e1f-af33-dc8af31a0ff8'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:12 devstack cinder-volume[81921]: WARNING cinder.quota [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-459901331 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-459901331, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['a2eab5c0-0140-4550-8667-80d331ade138', 'f809b14f-1a32-4f26-9045-e3edf36cd058', 'bc7c3f56-029f-488b-86e2-1b0955663b13', '5ab67e1e-5022-4a49-95cb-508fa5694ac1'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['e95a5176-2baf-4cc1-84ae-1d5c69c216d4', 'fab9e3dd-3fc4-4720-93ce-3913d8debcbd', 'af2b26cb-0b91-4cb4-8772-ef8b6b788c12', '114349f7-1bc1-4a9c-bc86-895530a024e6'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:12 devstack sudo[84079]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa" returned: 0 in 2.915s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76ff69e-dce4-4b00-b75c-5524c6000826]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:13 devstack sudo[84110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 Apr 15 22:21:13 devstack sudo[84110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:13 devstack sudo[84119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:13 devstack sudo[84119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:13 devstack sudo[84110]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5" returned: 0 in 0.741s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5, size 1024.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:21:13 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Converted 1024.00 MB image at 351.14 MB/s Apr 15 22:21:13 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:13 devstack sudo[84131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa Apr 15 22:21:13 devstack sudo[84131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:13 devstack sudo[84119]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.616s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:13 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:13 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-36499a5a-6bfc-463d-bfc8-ec3abb751513 tempest-GroupSnapshotsTest-475062089 None] Delete group completed successfully. Apr 15 22:21:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8c9b2ac8-7e77-45ae-8d82-2484ce8aa712 tempest-GroupSnapshotsTest-475062089 None] Group tempest-GroupSnapshotsTest-Group-259075850: creating Apr 15 22:21:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8c9b2ac8-7e77-45ae-8d82-2484ce8aa712 tempest-GroupSnapshotsTest-475062089 None] Group tempest-GroupSnapshotsTest-Group-259075850: created successfully Apr 15 22:21:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8c9b2ac8-7e77-45ae-8d82-2484ce8aa712 tempest-GroupSnapshotsTest-475062089 None] Create group completed successfully. Apr 15 22:21:14 devstack sudo[84131]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa" returned: 0 in 0.615s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-aad54d46-fa3a-406e-b926-dcdd6473c0aa" released by "_copy_volume_from_snapshot" :: held 5.387s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Acquiring lock "cinder-quobyte-cb22a7b3-039d-46f9-8ff5-7f4040021cc7" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-cb22a7b3-039d-46f9-8ff5-7f4040021cc7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Deleting offline snapshot cb22a7b3-039d-46f9-8ff5-7f4040021cc7 of volume c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] snapshot_file for this snap is: volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f792361-ac12-4c4a-a193-999cfe781844]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:14 devstack sudo[84136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 Apr 15 22:21:14 devstack sudo[84136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:14 devstack sudo[84136]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7" returned: 0 in 0.557s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[725c2bc1-baff-463a-9a9d-d8d59a53b701]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:14 devstack sudo[84141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 Apr 15 22:21:14 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:21:15 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (62c323ee-76a9-4494-9331-147c0d9c1d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fcfbf7c-01e9-479e-afae-003cdc12e9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fcfbf7c-01e9-479e-afae-003cdc12e9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182738278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=541e1a51-37e8-4840-9fc8-36b07d36205e,host='devstack@QuobyteHD#QuobyteHD',id=5ea210d0-76ca-4556-85a2-ff875832dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:15Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfed0e2a-3d25-4c83-b593-e5b10894a4d7),volume_type_id=dfed0e2a-3d25-4c83-b593-e5b10894a4d7)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67efd7ec-a28a-496f-ac62-345254904dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67efd7ec-a28a-496f-ac62-345254904dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a14275-b9c9-4806-843e-3af490f9acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a14275-b9c9-4806-843e-3af490f9acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea210d0-76ca-4556-85a2-ff875832dc14', 'volume_name': 'volume-5ea210d0-76ca-4556-85a2-ff875832dc14', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f8abff-2668-46ed-aa58-294dbbdfc1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f8abff-2668-46ed-aa58-294dbbdfc1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9edc37-5d76-4a18-9cb6-c163f4fb7905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Volume 5ea210d0-76ca-4556-85a2-ff875832dc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea210d0-76ca-4556-85a2-ff875832dc14', 'volume_size': 1} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5" returned: 0 in 0.625s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:15 devstack sudo[84146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 Apr 15 22:21:15 devstack sudo[84146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Flow 'volume_create_manager' (4089e750-221f-4c1c-b360-e0c3d790e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1146c4a5-5791-4568-a45b-ad8a7ad3eda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1146c4a5-5791-4568-a45b-ad8a7ad3eda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1030805514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3676e309-3c29-4d02-b18c-39ab6b674142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f4feace4dd4dfe827bf5cc60d15e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:16Z,use_quota=True,user_id='60f37add881e4eba8f9756c8ea6bb763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d76d9d-dd18-4100-bc65-a919e0f7e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d76d9d-dd18-4100-bc65-a919e0f7e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36eb725-e14b-44b2-a61f-853c1a0242d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36eb725-e14b-44b2-a61f-853c1a0242d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3676e309-3c29-4d02-b18c-39ab6b674142', 'volume_name': 'volume-3676e309-3c29-4d02-b18c-39ab6b674142', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae99bb7-dbda-4fd4-a253-d66cda625eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae99bb7-dbda-4fd4-a253-d66cda625eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87243a39-924b-4442-928a-ed70a1b67aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:15 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Volume 3676e309-3c29-4d02-b18c-39ab6b674142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3676e309-3c29-4d02-b18c-39ab6b674142', 'volume_size': 1} Apr 15 22:21:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:16 devstack sudo[84146]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7" returned: 0 in 0.530s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:16 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7 Apr 15 22:21:16 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:16 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5.cb22a7b3-039d-46f9-8ff5-7f4040021cc7" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-cb22a7b3-039d-46f9-8ff5-7f4040021cc7" released by "_delete_snapshot" :: held 2.230s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.711s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=541e1a51-37e8-4840-9fc8-36b07d36205e,created_at=2026-04-15T20:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182738278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=541e1a51-37e8-4840-9fc8-36b07d36205e,host='devstack@QuobyteHD#QuobyteHD',id=5ea210d0-76ca-4556-85a2-ff875832dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ad97e8cd9eb4e34a1b96cddf4a09350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:15Z,use_quota=True,user_id='71a8ee21882045aca8c23a7757510fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfed0e2a-3d25-4c83-b593-e5b10894a4d7),volume_type_id=dfed0e2a-3d25-4c83-b593-e5b10894a4d7)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Creating volume 5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:16 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:16 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 1073741824 Apr 15 22:21:16 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-90cb84a9-76bb-4929-9849-8c46d6a79c88 tempest-GroupsV314Test-829718327 None] Create group from source-group-11b984b3-bd8a-4935-9bc9-cc51a64a507b completed successfully. Apr 15 22:21:17 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 1073741824" returned: 0 in 0.508s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:17 devstack sudo[84159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 Apr 15 22:21:17 devstack sudo[84159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:17 devstack sudo[84161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:17 devstack sudo[84161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Acquiring lock "cinder-quobyte-aad54d46-fa3a-406e-b926-dcdd6473c0aa" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-aad54d46-fa3a-406e-b926-dcdd6473c0aa" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c23da-c5f3-4ad9-b012-5052e9daec2a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:17 devstack sudo[84166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa Apr 15 22:21:17 devstack sudo[84166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:17 devstack sudo[84159]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14" returned: 0 in 0.484s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1030805514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3676e309-3c29-4d02-b18c-39ab6b674142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f4feace4dd4dfe827bf5cc60d15e74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:16Z,use_quota=True,user_id='60f37add881e4eba8f9756c8ea6bb763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Creating volume 3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:17 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad9edc37-5d76-4a18-9cb6-c163f4fb7905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea210d0-76ca-4556-85a2-ff875832dc14', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:17 devstack sudo[84169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 1073741824 Apr 15 22:21:17 devstack sudo[84169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18052a21-2bc9-48b3-8804-23b6f5f3d3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:17 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Volume volume-5ea210d0-76ca-4556-85a2-ff875832dc14 (5ea210d0-76ca-4556-85a2-ff875832dc14): created successfully Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18052a21-2bc9-48b3-8804-23b6f5f3d3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Flow 'volume_create_manager' (62c323ee-76a9-4494-9331-147c0d9c1d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:17 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1d76342f-7efa-4ef0-aa57-518e949355da tempest-GroupSnapshotsTest-475062089 None] Created volume successfully. Apr 15 22:21:17 devstack sudo[84161]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:17 devstack sudo[84166]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa" returned: 0 in 0.533s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:17 devstack sudo[84178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa Apr 15 22:21:17 devstack sudo[84178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:18 devstack sudo[84169]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 1073741824" returned: 0 in 0.520s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:18 devstack sudo[84181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 Apr 15 22:21:18 devstack sudo[84181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:18 devstack sudo[84178]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aad54d46-fa3a-406e-b926-dcdd6473c0aa" returned: 0 in 0.439s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-aad54d46-fa3a-406e-b926-dcdd6473c0aa" released by "delete_volume" :: held 1.007s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Created reservations ['1126c383-c773-466c-a705-1648dd519ebb'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:18 devstack cinder-volume[81921]: WARNING cinder.quota [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-645615230 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-645615230, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:18 devstack cinder-volume[81921]: WARNING cinder.quota [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-645615230 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-645615230, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Created reservations ['45b8df9f-aff3-45dc-ba9f-8c802bed8ba3', '4cab19a1-867a-42c2-8f11-3249de83024c', '3260ecfb-0acd-4164-a5bf-50b52aed760f', 'cdd5b434-c0a2-4238-8fee-e13cc7b10635'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:18 devstack sudo[84181]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:18 devstack sudo[84185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:18 devstack sudo[84185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87243a39-924b-4442-928a-ed70a1b67aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3676e309-3c29-4d02-b18c-39ab6b674142', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbb5b24-aac5-4cf5-a78a-547c8f9fd9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:18 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Volume volume-3676e309-3c29-4d02-b18c-39ab6b674142 (3676e309-3c29-4d02-b18c-39ab6b674142): created successfully Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbb5b24-aac5-4cf5-a78a-547c8f9fd9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Flow 'volume_create_manager' (4089e750-221f-4c1c-b360-e0c3d790e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-02536228-51ae-4f27-9988-68d18f5ed411 req-9b3780fc-3753-4bb0-9cfb-e2edf63b4d80 tempest-VolumesSnapshotsTestJSON-1981863635 None] Created volume successfully. Apr 15 22:21:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] GroupSnapshot 23a19e5a-ee2f-49c3-ab8d-778ba630138e: creating. Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Group snapshot 23a19e5a-ee2f-49c3-ab8d-778ba630138e: creating. {{(pid=81921) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Creating offline snapshot 053356da-a64d-4d47-9785-8916fcd3e473 of volume 5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09d60a7-b195-40ca-99fe-21869f68f8b8]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:18 devstack sudo[84187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 Apr 15 22:21:18 devstack sudo[84187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:19 devstack sudo[84185]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:19 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5b245f3b-04bc-43c6-b650-361bb3573db9 tempest-GroupsV314Test-829718327 None] Delete group completed successfully. Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:19 devstack sudo[84187]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14" returned: 0 in 0.851s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:19 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 1G Apr 15 22:21:19 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Acquiring lock "cinder-quobyte-c8fe6839-094f-4c5b-b28b-54bca27e21f5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-c8fe6839-094f-4c5b-b28b-54bca27e21f5" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd629d9-6c01-4f24-b1c3-7963acfd1fbb]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:19 devstack sudo[84224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 Apr 15 22:21:19 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:20 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 1G" returned: 0 in 0.588s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea210d0-76ca-4556-85a2-ff875832dc14 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:20 devstack sudo[84232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea210d0-76ca-4556-85a2-ff875832dc14 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 Apr 15 22:21:20 devstack sudo[84232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:20 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5" returned: 0 in 0.568s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:20 devstack sudo[84234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5 Apr 15 22:21:20 devstack sudo[84234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:20 devstack sudo[84232]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ea210d0-76ca-4556-85a2-ff875832dc14 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:20 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:20 devstack sudo[84240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 Apr 15 22:21:20 devstack sudo[84240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:20 devstack sudo[84234]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c8fe6839-094f-4c5b-b28b-54bca27e21f5" returned: 0 in 0.441s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Lock "cinder-quobyte-c8fe6839-094f-4c5b-b28b-54bca27e21f5" released by "delete_volume" :: held 1.073s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Created reservations ['c7f49bea-ecc0-437d-8b40-2c1597f12de3'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:20 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Created reservations ['ff95bb83-8c53-4bcc-92ca-bbecf09ee376', '6148df2d-7040-4a71-926d-81966707dfd7', 'a898c44c-db60-4384-9b9d-21573a720f90', 'fc761fb6-0408-4fc4-98d0-42a5592b6d70'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:21 devstack sudo[84242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:21 devstack sudo[84242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:21 devstack sudo[84240]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473" returned: 0 in 0.534s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:21 devstack sudo[84245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.info Apr 15 22:21:21 devstack sudo[84245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:21 devstack sudo[84242]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.602s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:21 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6f38a899-15ce-4358-a2ab-1f9136cfe1d2 tempest-GroupsV314Test-829718327 None] Delete group completed successfully. Apr 15 22:21:21 devstack sudo[84245]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.info" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:21 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:21 devstack sudo[84251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.info Apr 15 22:21:21 devstack sudo[84251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:22 devstack sudo[84251]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.info" returned: 0 in 0.417s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.409s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.971s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Creating offline snapshot db06a0d9-51ad-4be5-92ed-866be08cfd87 of volume 3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae342749-d877-408b-ac75-fd75a30cc5f4]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:22 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1c15564c-b9c3-4bc3-9df2-ac42b62c16d5 tempest-GroupSnapshotsTest-475062089 None] group_snapshot 23a19e5a-ee2f-49c3-ab8d-778ba630138e: created successfully Apr 15 22:21:22 devstack sudo[84256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 Apr 15 22:21:22 devstack sudo[84256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:22 devstack sudo[84256]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:22 devstack sudo[84261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 1G Apr 15 22:21:22 devstack sudo[84261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:23 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] group_snapshot 23a19e5a-ee2f-49c3-ab8d-778ba630138e: deleting Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] group_snapshot 23a19e5a-ee2f-49c3-ab8d-778ba630138e: deleting {{(pid=81921) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-5ea210d0-76ca-4556-85a2-ff875832dc14" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-5ea210d0-76ca-4556-85a2-ff875832dc14" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-053356da-a64d-4d47-9785-8916fcd3e473" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-053356da-a64d-4d47-9785-8916fcd3e473" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Deleting offline snapshot 053356da-a64d-4d47-9785-8916fcd3e473 of volume 5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] snapshot_file for this snap is: volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[70728885-9f2a-4661-a544-9b3f29693ff4]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:23 devstack sudo[84267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 Apr 15 22:21:23 devstack sudo[84267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:23 devstack sudo[84261]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 1G" returned: 0 in 0.746s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3676e309-3c29-4d02-b18c-39ab6b674142 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:23 devstack sudo[84269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3676e309-3c29-4d02-b18c-39ab6b674142 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 Apr 15 22:21:23 devstack sudo[84269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:24 devstack sudo[84267]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473" returned: 0 in 0.755s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ea210d0-76ca-4556-85a2-ff875832dc14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4985639-d94e-42d1-b8be-4369e726f8ad]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:24 devstack sudo[84276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 Apr 15 22:21:24 devstack sudo[84276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:24 devstack sudo[84269]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3676e309-3c29-4d02-b18c-39ab6b674142 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87" returned: 0 in 0.693s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:24 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 is being set with open permissions: ugo+rw Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:24 devstack sudo[84280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 Apr 15 22:21:24 devstack sudo[84280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:24 devstack sudo[84276]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14" returned: 0 in 0.654s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:24 devstack sudo[84286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 Apr 15 22:21:24 devstack sudo[84286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:24 devstack sudo[84280]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87" returned: 0 in 0.559s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:24 devstack sudo[84288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.info Apr 15 22:21:24 devstack sudo[84288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:25 devstack sudo[84288]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.info" returned: 0 in 0.512s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:25 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.info is being set with open permissions: ugo+rw Apr 15 22:21:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:25 devstack sudo[84300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.info Apr 15 22:21:25 devstack sudo[84300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:25 devstack sudo[84286]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473" returned: 0 in 0.685s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:25 devstack sudo[84303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473 Apr 15 22:21:25 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:25 devstack sudo[84300]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.info" returned: 0 in 0.637s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:25 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.753s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14.053356da-a64d-4d47-9785-8916fcd3e473" returned: 0 in 0.571s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-053356da-a64d-4d47-9785-8916fcd3e473" released by "_delete_snapshot" :: held 2.743s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:26 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-60279f04-9be1-473a-adf9-749392b222b6 req-b3257fad-4bcc-4279-a3c4-429bf48a2ce0 tempest-VolumesSnapshotsTestJSON-1981863635 None] Create snapshot completed successfully Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-5ea210d0-76ca-4556-85a2-ff875832dc14" released by "delete_snapshot" :: held 2.774s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:26 devstack cinder-volume[81921]: WARNING cinder.quota [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-971948176 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-971948176, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:26 devstack cinder-volume[81921]: WARNING cinder.quota [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-971948176 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-971948176, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] Created reservations ['805c591e-b994-451e-b8f2-12b42308f910', '31c70fec-f18d-4f33-98a9-2e6db5b3f534', '2904359d-4896-4c02-b8fd-3f01d54817d5', '7a87e979-c592-4b78-9847-a9c959897a68'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:26 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3fdbe0e8-868c-458b-9f6b-d3182e9b24db tempest-GroupSnapshotsTest-475062089 None] group_snapshot 23a19e5a-ee2f-49c3-ab8d-778ba630138e: deleted successfully Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "cinder-quobyte-5ea210d0-76ca-4556-85a2-ff875832dc14" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-5ea210d0-76ca-4556-85a2-ff875832dc14" acquired by "delete_volume" :: waited 0.028s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbe593e-1dc5-4702-a081-e4c1d45f6396]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "cinder-db06a0d9-51ad-4be5-92ed-866be08cfd87-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:26 devstack sudo[84329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 Apr 15 22:21:26 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-db06a0d9-51ad-4be5-92ed-866be08cfd87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "cinder-quobyte-3676e309-3c29-4d02-b18c-39ab6b674142" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-quobyte-3676e309-3c29-4d02-b18c-39ab6b674142" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "cinder-quobyte-db06a0d9-51ad-4be5-92ed-866be08cfd87" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-quobyte-db06a0d9-51ad-4be5-92ed-866be08cfd87" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Deleting offline snapshot db06a0d9-51ad-4be5-92ed-866be08cfd87 of volume 3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] snapshot_file for this snap is: volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6084f8ee-07bd-42cc-a705-ea866d0a0896]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:27 devstack sudo[84331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 Apr 15 22:21:27 devstack sudo[84331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:27 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14" returned: 0 in 0.918s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:27 devstack sudo[84340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14 Apr 15 22:21:27 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:28 devstack sudo[84331]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87" returned: 0 in 0.988s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3676e309-3c29-4d02-b18c-39ab6b674142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa768d56-b993-47e3-a59a-fc7f499dded0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:28 devstack sudo[84342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 Apr 15 22:21:28 devstack sudo[84342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:28 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5ea210d0-76ca-4556-85a2-ff875832dc14" returned: 0 in 0.734s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Lock "cinder-quobyte-5ea210d0-76ca-4556-85a2-ff875832dc14" released by "delete_volume" :: held 1.711s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['e4df5356-d0de-4e8c-bea7-32ad6e8d498f'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:28 devstack cinder-volume[81921]: WARNING cinder.quota [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-971948176 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-971948176, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Created reservations ['09d2af6f-c3e9-4f62-b946-f393b4bd0493', 'd4b6c01b-3c5a-4490-a602-f0a097ee7300', '10350004-6eb8-4504-9201-7772e6974522', '40d38ea3-e880-485d-bbbd-7a1419e3996a'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:28 devstack sudo[84347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:28 devstack sudo[84347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:28 devstack sudo[84342]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142" returned: 0 in 0.792s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:28 devstack sudo[84350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 Apr 15 22:21:28 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:29 devstack sudo[84347]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.742s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:29 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:29 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2a0a33d0-7e2a-4115-9aab-4a6aeffa9402 tempest-GroupSnapshotsTest-475062089 None] Delete group completed successfully. Apr 15 22:21:29 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87" returned: 0 in 0.658s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:29 devstack sudo[84356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87 Apr 15 22:21:29 devstack sudo[84356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:30 devstack sudo[84356]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142.db06a0d9-51ad-4be5-92ed-866be08cfd87" returned: 0 in 0.659s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-quobyte-db06a0d9-51ad-4be5-92ed-866be08cfd87" released by "_delete_snapshot" :: held 3.178s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-quobyte-3676e309-3c29-4d02-b18c-39ab6b674142" released by "delete_snapshot" :: held 3.197s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:30 devstack cinder-volume[81921]: WARNING cinder.quota [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:30 devstack cinder-volume[81921]: DEBUG cinder.quota [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Created reservations ['139e770d-45c0-48c0-b748-fe8e59df0be7', 'cb2215e7-c274-4c43-b0c5-325dbe8749ad', 'b72a7aae-96b2-49f8-9554-6c20d9be6b33', '0cbaa3a1-83f4-4108-95c4-2f093e3e5d94'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:30 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Delete snapshot completed successfully. Apr 15 22:21:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-0863ec65-0890-4722-ab80-2fa6db2cc2bf req-676cd2d2-56d7-4520-8d33-ac9e5d5afa63 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-db06a0d9-51ad-4be5-92ed-866be08cfd87-delete_snapshot" released by "delete_snapshot" :: held 3.326s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "cinder-3676e309-3c29-4d02-b18c-39ab6b674142-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-3676e309-3c29-4d02-b18c-39ab6b674142-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "cinder-quobyte-3676e309-3c29-4d02-b18c-39ab6b674142" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-quobyte-3676e309-3c29-4d02-b18c-39ab6b674142" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:31 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa446ad-1aaa-41f0-981f-8269ed051cfa]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:31 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 Apr 15 22:21:31 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:32 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142" returned: 0 in 0.622s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:32 devstack sudo[84371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142 Apr 15 22:21:32 devstack sudo[84371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:32 devstack sudo[84371]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3676e309-3c29-4d02-b18c-39ab6b674142" returned: 0 in 0.601s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-quobyte-3676e309-3c29-4d02-b18c-39ab6b674142" released by "delete_volume" :: held 1.268s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG cinder.quota [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Created reservations ['82d53b98-9eb6-4a17-8651-4ffe3719e41c', 'ae1587b3-e494-4dbd-82a4-8edbc2876be1', 'ad4dd2b3-7be0-4981-8994-ed6fd2598c43', '4a267e83-456a-423f-af49-94c21faa0e83'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:32 devstack sudo[84374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:32 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Flow 'volume_create_manager' (f067c7cc-d395-4881-a36a-dfcee546c3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249cccf6-2291-4511-95c6-00acaa404b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249cccf6-2291-4511-95c6-00acaa404b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1876368735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b2ef2b-6830-43ce-acee-8584a6e2c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b426f67e0148a99f19d7ab33ac588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:33Z,use_quota=True,user_id='fcbf8ca290cb4ae99ce472588ad06e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce80137a-ed81-4973-919e-fd7dd8328fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:33 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce80137a-ed81-4973-919e-fd7dd8328fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae41b64-76a7-49ce-aaa1-35d817c81d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae41b64-76a7-49ce-aaa1-35d817c81d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b2ef2b-6830-43ce-acee-8584a6e2c649', 'volume_name': 'volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab14f34-2283-48a3-a20d-f88498ed1d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ab14f34-2283-48a3-a20d-f88498ed1d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67ec975-7bf2-4286-93b7-b4edf4edcfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:33 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Volume b6b2ef2b-6830-43ce-acee-8584a6e2c649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649', 'volume_size': 1} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1876368735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b2ef2b-6830-43ce-acee-8584a6e2c649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b426f67e0148a99f19d7ab33ac588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:33Z,use_quota=True,user_id='fcbf8ca290cb4ae99ce472588ad06e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Creating volume b6b2ef2b-6830-43ce-acee-8584a6e2c649 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:33 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.763s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.manager [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Deleted volume successfully. Apr 15 22:21:33 devstack sudo[84377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 1073741824 Apr 15 22:21:33 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-b49f43eb-0093-43c3-9d12-b0210d7e3ad6 req-a13da944-dfb0-493f-86ce-246cc9a638b8 tempest-VolumesSnapshotsTestJSON-1981863635 None] Lock "cinder-3676e309-3c29-4d02-b18c-39ab6b674142-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:34 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 1073741824" returned: 0 in 0.753s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:34 devstack sudo[84382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 Apr 15 22:21:34 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:35 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649" returned: 0 in 0.664s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67ec975-7bf2-4286-93b7-b4edf4edcfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedcfb9d-dd0b-4593-a9dc-862536d19de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:35 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Volume volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 (b6b2ef2b-6830-43ce-acee-8584a6e2c649): created successfully Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedcfb9d-dd0b-4593-a9dc-862536d19de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Flow 'volume_create_manager' (f067c7cc-d395-4881-a36a-dfcee546c3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:35 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-40135e49-29bc-49a2-be3f-e69aa7686769 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Created volume successfully. Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Acquiring lock "cinder-b6b2ef2b-6830-43ce-acee-8584a6e2c649-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "cinder-b6b2ef2b-6830-43ce-acee-8584a6e2c649-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Acquiring lock "cinder-quobyte-b6b2ef2b-6830-43ce-acee-8584a6e2c649" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "cinder-quobyte-b6b2ef2b-6830-43ce-acee-8584a6e2c649" acquired by "delete_volume" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffee48a-ce7a-45a4-bbdf-9e0cd1857df3]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:36 devstack sudo[84385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 Apr 15 22:21:36 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Flow 'volume_create_manager' (b4cfff5d-c4de-4836-b948-e83d1d883e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11786ecd-db3b-401b-a80e-b3ffe143eec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:37 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11786ecd-db3b-401b-a80e-b3ffe143eec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:37Z,deleted=False,deleted_at=None,display_description='',display_name='80c8a123-036f-4cce-92b9-ef5570af7477-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a48df8-b132-4ec7-9ffc-7f90ffe7d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baa72c426744120bb901c9368348a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:37Z,use_quota=True,user_id='078750a0453c471e98962b718909c200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974982d9-e001-4c05-8ca5-9602c0ceb648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (974982d9-e001-4c05-8ca5-9602c0ceb648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67362ef-d40e-4191-a688-3c36d2a08601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d67362ef-d40e-4191-a688-3c36d2a08601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8a48df8-b132-4ec7-9ffc-7f90ffe7d626', 'volume_name': 'volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2d3175-8483-4f2a-a8cd-8b6a8821a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2d3175-8483-4f2a-a8cd-8b6a8821a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f75e2b5-ed38-4311-89be-2a54f600b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:37 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Volume f8a48df8-b132-4ec7-9ffc-7f90ffe7d626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626', 'volume_size': 1} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:37Z,deleted=False,deleted_at=None,display_description='',display_name='80c8a123-036f-4cce-92b9-ef5570af7477-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a48df8-b132-4ec7-9ffc-7f90ffe7d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baa72c426744120bb901c9368348a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:37Z,use_quota=True,user_id='078750a0453c471e98962b718909c200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Creating volume f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:37 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649" returned: 0 in 1.430s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:37 devstack sudo[84393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 1073741824 Apr 15 22:21:37 devstack sudo[84393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:37 devstack sudo[84394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649 Apr 15 22:21:37 devstack sudo[84394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:38 devstack sudo[84394]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b6b2ef2b-6830-43ce-acee-8584a6e2c649" returned: 0 in 0.949s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "cinder-quobyte-b6b2ef2b-6830-43ce-acee-8584a6e2c649" released by "delete_volume" :: held 2.418s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Created reservations ['49adb03c-158e-4cdc-b0b4-8176bb2dd1be', '9614fb5a-d3e9-4dec-9f11-17174782a81f', '851b347d-1a6f-4623-8384-59549fa02d17', 'f56600f2-6dce-4005-b6b4-b734507803c3'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f30f6c0a-cc25-4714-8f96-64ef9072bb9a tempest-GroupSnapshotsV319Test-1019574687 None] Group tempest-GroupSnapshotsV319Test-Group-1567682053: creating Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f30f6c0a-cc25-4714-8f96-64ef9072bb9a tempest-GroupSnapshotsV319Test-1019574687 None] Group tempest-GroupSnapshotsV319Test-Group-1567682053: created successfully Apr 15 22:21:38 devstack sudo[84403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:38 devstack sudo[84403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f30f6c0a-cc25-4714-8f96-64ef9072bb9a tempest-GroupSnapshotsV319Test-1019574687 None] Create group completed successfully. Apr 15 22:21:38 devstack sudo[84393]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 1073741824" returned: 0 in 1.345s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:38 devstack sudo[84405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 Apr 15 22:21:38 devstack sudo[84405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-50e8f82b-4d22-4e9d-885c-f6697d8d99d0 tempest-GroupsV320Test-1635701451 None] Group tempest-GroupsV320Test-Group-439184589: creating Apr 15 22:21:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-50e8f82b-4d22-4e9d-885c-f6697d8d99d0 tempest-GroupsV320Test-1635701451 None] Group tempest-GroupsV320Test-Group-439184589: created successfully Apr 15 22:21:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-50e8f82b-4d22-4e9d-885c-f6697d8d99d0 tempest-GroupsV320Test-1635701451 None] Create group completed successfully. Apr 15 22:21:38 devstack sudo[84403]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:38 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Deleted volume successfully. Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0f86776b-5faa-4ab9-a0fe-b2e66a92ab71 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "cinder-b6b2ef2b-6830-43ce-acee-8584a6e2c649-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:39 devstack sudo[84405]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626" returned: 0 in 0.442s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f75e2b5-ed38-4311-89be-2a54f600b541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9471f245-31ca-4113-bb5f-5e8fe4136b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Volume volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 (f8a48df8-b132-4ec7-9ffc-7f90ffe7d626): created successfully Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9471f245-31ca-4113-bb5f-5e8fe4136b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Flow 'volume_create_manager' (b4cfff5d-c4de-4836-b948-e83d1d883e01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-236ca5eb-08b5-46c8-b402-7dd03b22002e tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Created volume successfully. Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Flow 'volume_create_manager' (7dbe593d-668f-4a5f-8a87-69972bdb9546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d8d256-792c-4bf5-87de-e7cbe3cf0120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d8d256-792c-4bf5-87de-e7cbe3cf0120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1341318403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b426f67e0148a99f19d7ab33ac588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:39Z,use_quota=True,user_id='fcbf8ca290cb4ae99ce472588ad06e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8260e81d-8aaa-4596-8ea3-75fd3fa79d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8260e81d-8aaa-4596-8ea3-75fd3fa79d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8e4d9c-5e0f-4b05-8353-59e550102533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8e4d9c-5e0f-4b05-8353-59e550102533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841', 'volume_name': 'volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ea50ba-d05e-40f4-a40d-04e46c0a02c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ea50ba-d05e-40f4-a40d-04e46c0a02c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573a8609-a4d9-4b91-ac8d-c702e9b2b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Volume 49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841', 'volume_size': 1} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1341318403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b426f67e0148a99f19d7ab33ac588f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:39Z,use_quota=True,user_id='fcbf8ca290cb4ae99ce472588ad06e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Creating volume 49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:39 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:39 devstack sudo[84410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 1073741824 Apr 15 22:21:39 devstack sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Flow 'volume_create_manager' (86773873-0e5b-4873-b818-f55d8245477d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51863915-abe1-4d8e-b2bb-918f4184944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51863915-abe1-4d8e-b2bb-918f4184944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1442247809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe9b633a-eb45-4fe4-b2fe-8fd6afd02313,host='devstack@QuobyteHD#QuobyteHD',id=238edf06-c6d6-4661-8892-5440ce0a9d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91315f522284ad3865e2dcb3bfabfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:40Z,use_quota=True,user_id='01c50c6e6cf246f594cc63e1156d3bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(933e7ba3-2dfd-46b1-8004-b84d906bc2c6),volume_type_id=933e7ba3-2dfd-46b1-8004-b84d906bc2c6)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bb199d-1581-45e8-927a-a9b9c6d5cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56bb199d-1581-45e8-927a-a9b9c6d5cf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823b0dfc-1897-4859-89a6-12c2b80aa3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823b0dfc-1897-4859-89a6-12c2b80aa3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '238edf06-c6d6-4661-8892-5440ce0a9d05', 'volume_name': 'volume-238edf06-c6d6-4661-8892-5440ce0a9d05', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd727359-bdd4-46f5-b834-6b6fd2510250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd727359-bdd4-46f5-b834-6b6fd2510250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ffbb01-7a93-4ef0-931d-1d978a2a0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:39 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Volume 238edf06-c6d6-4661-8892-5440ce0a9d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-238edf06-c6d6-4661-8892-5440ce0a9d05', 'volume_size': 1} Apr 15 22:21:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:40 devstack sudo[84410]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 1073741824" returned: 0 in 0.700s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Created reservations ['ab719f2f-105b-426a-a846-334c1a785203'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:40 devstack sudo[84419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 Apr 15 22:21:40 devstack sudo[84419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:40 devstack sudo[84427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:40 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-ff3fa541-1edd-4cbf-b2e5-a180a6652419 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:40 devstack sudo[84419]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe9b633a-eb45-4fe4-b2fe-8fd6afd02313,created_at=2026-04-15T20:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1442247809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe9b633a-eb45-4fe4-b2fe-8fd6afd02313,host='devstack@QuobyteHD#QuobyteHD',id=238edf06-c6d6-4661-8892-5440ce0a9d05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91315f522284ad3865e2dcb3bfabfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:40Z,use_quota=True,user_id='01c50c6e6cf246f594cc63e1156d3bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(933e7ba3-2dfd-46b1-8004-b84d906bc2c6),volume_type_id=933e7ba3-2dfd-46b1-8004-b84d906bc2c6)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Creating volume 238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:40 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573a8609-a4d9-4b91-ac8d-c702e9b2b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9823d37e-e9e9-4873-98fd-2a1847bf7ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:40 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 1073741824 Apr 15 22:21:40 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Volume volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 (49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841): created successfully Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9823d37e-e9e9-4873-98fd-2a1847bf7ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Flow 'volume_create_manager' (7dbe593d-668f-4a5f-8a87-69972bdb9546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-332889b5-96e7-4dc2-a16f-8e50bd3d3ce5 tempest-VolumeQuotasAdminTestJSON-1024753006 None] Created volume successfully. Apr 15 22:21:40 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.583s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-89ce5601-f188-4b5f-a400-141627a37318 tempest-GroupsV320Test-1635701451 None] Delete group completed successfully. Apr 15 22:21:41 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 1073741824" returned: 0 in 0.518s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:41 devstack sudo[84456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 Apr 15 22:21:41 devstack sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:41 devstack sudo[84456]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05" returned: 0 in 0.537s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-ff3fa541-1edd-4cbf-b2e5-a180a6652419 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.398s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6ffbb01-7a93-4ef0-931d-1d978a2a0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-238edf06-c6d6-4661-8892-5440ce0a9d05', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b6bb51-42f6-44fd-8dba-219f0a605ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2aaea3-443a-40ec-9a73-2441daa7bbef]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-ff3fa541-1edd-4cbf-b2e5-a180a6652419 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Volume volume-238edf06-c6d6-4661-8892-5440ce0a9d05 (238edf06-c6d6-4661-8892-5440ce0a9d05): created successfully Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b6bb51-42f6-44fd-8dba-219f0a605ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Flow 'volume_create_manager' (86773873-0e5b-4873-b818-f55d8245477d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ea4e6af0-5051-4d4d-ab31-63dbe76db383 tempest-GroupSnapshotsV319Test-1019574687 None] Created volume successfully. Apr 15 22:21:42 devstack sudo[84464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 Apr 15 22:21:42 devstack sudo[84464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-54f37b49-dea3-4055-a7f6-a78a9e60a218 tempest-VolumeQuotasAdminTestJSON-1352844579 None] Transfer volume completed successfully. Apr 15 22:21:42 devstack sudo[84464]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-ff3fa541-1edd-4cbf-b2e5-a180a6652419 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626" returned: 0 in 0.614s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-ff3fa541-1edd-4cbf-b2e5-a180a6652419 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.636s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-ff3fa541-1edd-4cbf-b2e5-a180a6652419 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6', 'name': 'volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f143554f-f5cf-4da9-974f-8d17e28115c3', 'enforce_multipath': True} {{(pid=81921) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 22:21:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-2193e822-b5d8-46e6-b1ba-6fcf569bda2f req-ff3fa541-1edd-4cbf-b2e5-a180a6652419 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] attachment_update completed successfully. Apr 15 22:21:43 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] GroupSnapshot 22ce032f-b6a6-479e-8bb7-aeae9ae9bf98: creating. Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Group snapshot 22ce032f-b6a6-479e-8bb7-aeae9ae9bf98: creating. {{(pid=81921) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Creating offline snapshot f32e2e4d-fda8-46ba-a9fe-89ba965493e6 of volume 238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f151bf08-da94-4cf5-bb13-05252c88569f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:43 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 Apr 15 22:21:43 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Acquiring lock "cinder-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Lock "cinder-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Acquiring lock "cinder-quobyte-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Lock "cinder-quobyte-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841" acquired by "delete_volume" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbcfcbe-6153-43b3-b4b8-73ace2f369bd]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:43 devstack sudo[84472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 Apr 15 22:21:43 devstack sudo[84472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:43 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05" returned: 0 in 0.651s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:43 devstack sudo[84477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 1G Apr 15 22:21:43 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:44 devstack sudo[84472]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841" returned: 0 in 0.655s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:44 devstack sudo[84482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841 Apr 15 22:21:44 devstack sudo[84482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:44 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 1G" returned: 0 in 0.871s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238edf06-c6d6-4661-8892-5440ce0a9d05 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:44 devstack sudo[84552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238edf06-c6d6-4661-8892-5440ce0a9d05 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 Apr 15 22:21:44 devstack sudo[84552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:44 devstack sudo[84482]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841" returned: 0 in 0.778s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Lock "cinder-quobyte-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841" released by "delete_volume" :: held 1.461s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:44 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Created reservations ['fca78f22-86be-436f-a145-8fa5ca88cb27', '2b9d3223-612a-4ecc-97e6-9cce960ccb72', 'ea2bef1f-3120-4eee-beba-bc0f6e144ec0', '209e6c48-d6bb-4194-b286-35d84f3a2bfd'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:45 devstack sudo[84557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:45 devstack sudo[84557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:45 devstack sudo[84552]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-238edf06-c6d6-4661-8892-5440ce0a9d05 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6" returned: 0 in 0.598s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:45 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:45 devstack sudo[84562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 Apr 15 22:21:45 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:45 devstack sudo[84557]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.528s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Deleted volume successfully. Apr 15 22:21:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f2a9bbe3-a9f1-4865-814a-d9e469d6b547 tempest-VolumeQuotasAdminTestJSON-342960618 None] Lock "cinder-49aaa812-fc3f-4bb3-bd3a-6ef7f3c11841-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:46 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6" returned: 0 in 0.663s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:46 devstack sudo[84569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.info Apr 15 22:21:46 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:46 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.info" returned: 0 in 0.628s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:46 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 22:21:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:46 devstack sudo[84572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.info Apr 15 22:21:46 devstack sudo[84572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:47 devstack sudo[84572]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.info" returned: 0 in 0.554s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.049s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:47 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8d9091df-5b74-4367-bae2-910ef11accc2 tempest-GroupSnapshotsV319Test-1019574687 None] group_snapshot 22ce032f-b6a6-479e-8bb7-aeae9ae9bf98: created successfully Apr 15 22:21:48 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] group_snapshot 22ce032f-b6a6-479e-8bb7-aeae9ae9bf98: deleting Apr 15 22:21:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] group_snapshot 22ce032f-b6a6-479e-8bb7-aeae9ae9bf98: deleting {{(pid=81921) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 22:21:48 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Acquiring lock "cinder-quobyte-238edf06-c6d6-4661-8892-5440ce0a9d05" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:48 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Lock "cinder-quobyte-238edf06-c6d6-4661-8892-5440ce0a9d05" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:48 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Acquiring lock "cinder-quobyte-f32e2e4d-fda8-46ba-a9fe-89ba965493e6" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Lock "cinder-quobyte-f32e2e4d-fda8-46ba-a9fe-89ba965493e6" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Deleting offline snapshot f32e2e4d-fda8-46ba-a9fe-89ba965493e6 of volume 238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] snapshot_file for this snap is: volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[26595cb8-6e7a-4680-91c2-254be230860e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:49 devstack sudo[84915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 Apr 15 22:21:49 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:49 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6" returned: 0 in 0.675s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-238edf06-c6d6-4661-8892-5440ce0a9d05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14ab228-94ac-4ee5-89a9-ab8fbba3eb2f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:49 devstack sudo[84920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 Apr 15 22:21:49 devstack sudo[84920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:50 devstack sudo[84920]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05" returned: 0 in 0.577s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:50 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 Apr 15 22:21:50 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:51 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6" returned: 0 in 0.718s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:51 devstack sudo[84931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6 Apr 15 22:21:51 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:51 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05.f32e2e4d-fda8-46ba-a9fe-89ba965493e6" returned: 0 in 0.700s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Lock "cinder-quobyte-f32e2e4d-fda8-46ba-a9fe-89ba965493e6" released by "_delete_snapshot" :: held 2.813s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Lock "cinder-quobyte-238edf06-c6d6-4661-8892-5440ce0a9d05" released by "delete_snapshot" :: held 2.861s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Flow 'volume_create_manager' (347ebbf3-6eea-4c3c-8e64-3bc70c0564c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d974b54f-3c90-41ba-94d0-a1fd6d0bedaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d974b54f-3c90-41ba-94d0-a1fd6d0bedaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1687839435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f934567-026b-4c2f-bb2d-5d4bcbed10d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d0ccc6e2ad4d558d4ceaa5f81c1a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:52Z,use_quota=True,user_id='2c53a560442d41c0a591f43d968f6bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caecbe6d-6888-4405-b80f-6bb50bf3995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caecbe6d-6888-4405-b80f-6bb50bf3995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e884ef1-1dec-43c3-9148-992c8d4edd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e884ef1-1dec-43c3-9148-992c8d4edd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f934567-026b-4c2f-bb2d-5d4bcbed10d4', 'volume_name': 'volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3ac61c-c0a6-4560-9fe9-5567f4c5135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a3ac61c-c0a6-4560-9fe9-5567f4c5135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b60a722-ab9e-41a3-9c03-e20acecd3d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:51 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Volume 1f934567-026b-4c2f-bb2d-5d4bcbed10d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4', 'volume_size': 1} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1687839435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f934567-026b-4c2f-bb2d-5d4bcbed10d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d0ccc6e2ad4d558d4ceaa5f81c1a09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:21:52Z,use_quota=True,user_id='2c53a560442d41c0a591f43d968f6bea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Creating volume 1f934567-026b-4c2f-bb2d-5d4bcbed10d4 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:21:51 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:21:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:52 devstack cinder-volume[81921]: WARNING cinder.quota [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1688282558 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1688282558, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:52 devstack cinder-volume[81921]: WARNING cinder.quota [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1688282558 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1688282558, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:52 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 1073741824 Apr 15 22:21:52 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:52 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] Created reservations ['cfb15074-147d-4666-bdd1-7aae679a5ed3', '9c488a47-a001-4222-8c74-d8b7c7a60db4', '81d5f64d-1aa8-4b6d-a2ba-73192a7942f0', 'c89add02-af0a-4d93-9ca5-b69e767b92e6'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:52 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-67510184-a731-48b3-93c1-1fd2f3e8024c tempest-GroupSnapshotsV319Test-1019574687 None] group_snapshot 22ce032f-b6a6-479e-8bb7-aeae9ae9bf98: deleted successfully Apr 15 22:21:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Acquiring lock "cinder-quobyte-238edf06-c6d6-4661-8892-5440ce0a9d05" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Lock "cinder-quobyte-238edf06-c6d6-4661-8892-5440ce0a9d05" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:52 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[205bbe2e-4726-4dd1-ba18-e3f1b437ec40]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:52 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 Apr 15 22:21:52 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:52 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 1073741824" returned: 0 in 0.707s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:52 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 Apr 15 22:21:52 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:53 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05" returned: 0 in 0.624s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:53 devstack sudo[84949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05 Apr 15 22:21:53 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:53 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4" returned: 0 in 0.550s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b60a722-ab9e-41a3-9c03-e20acecd3d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0be38a-2143-46a1-8b3c-75a7e3e8c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:21:53 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Volume volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 (1f934567-026b-4c2f-bb2d-5d4bcbed10d4): created successfully Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0be38a-2143-46a1-8b3c-75a7e3e8c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Flow 'volume_create_manager' (347ebbf3-6eea-4c3c-8e64-3bc70c0564c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:21:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-46697c26-4f3b-44b1-ad11-e4c228a36c9b tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Created volume successfully. Apr 15 22:21:53 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-238edf06-c6d6-4661-8892-5440ce0a9d05" returned: 0 in 0.531s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Lock "cinder-quobyte-238edf06-c6d6-4661-8892-5440ce0a9d05" released by "delete_volume" :: held 1.194s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Created reservations ['d5c9d1c6-c8a7-49c2-a4dc-e52c8d5c62dc'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:53 devstack cinder-volume[81921]: WARNING cinder.quota [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1688282558 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1688282558, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Created reservations ['89c24037-dff6-4558-a439-7015431a9bdb', '79cbe5df-2987-44a2-9bfc-ce772869a0a6', '4f22906c-cf39-406c-a2e3-347577892eb2', '4e4000b6-adc4-45d2-826a-3d62a3934893'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:53 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:53 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:54 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.601s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e6728249-019f-495e-b838-cbcea969b5bf tempest-GroupSnapshotsV319Test-1019574687 None] Delete group completed successfully. Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Acquiring lock "cinder-1f934567-026b-4c2f-bb2d-5d4bcbed10d4-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "cinder-1f934567-026b-4c2f-bb2d-5d4bcbed10d4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Acquiring lock "cinder-quobyte-1f934567-026b-4c2f-bb2d-5d4bcbed10d4" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "cinder-quobyte-1f934567-026b-4c2f-bb2d-5d4bcbed10d4" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcbbf76-a892-4d47-8f62-3aef28ee05e2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:21:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:54 devstack sudo[84955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 Apr 15 22:21:54 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:55 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4" returned: 0 in 0.696s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:55 devstack sudo[84985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4 Apr 15 22:21:55 devstack sudo[84985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:56 devstack sudo[84985]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1f934567-026b-4c2f-bb2d-5d4bcbed10d4" returned: 0 in 0.616s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "cinder-quobyte-1f934567-026b-4c2f-bb2d-5d4bcbed10d4" released by "delete_volume" :: held 1.343s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Created reservations ['cacdfb5d-bc50-4e0c-9571-b13b89f00592', '88d2df12-b345-44b8-8c8b-8ffcbf60174b', '49885a1a-4a32-4ff9-b27a-0cdd245e6134', 'b0c4ef7f-419f-4fc4-8531-5f1d471b8707'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:21:56 devstack sudo[84989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:21:56 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:21:56 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.452s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:21:56 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Deleted volume successfully. Apr 15 22:21:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6e5dcfb1-d5d8-406f-aff4-279479ee9cef tempest-VolumeQuotasNegativeTestJSON-1369734724 None] Lock "cinder-1f934567-026b-4c2f-bb2d-5d4bcbed10d4-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:21:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-cfffea99-d5f7-42bf-881d-eda94e78a00f tempest-GroupsTest-536896383 None] Group tempest-Group1-981149618: creating Apr 15 22:21:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-cfffea99-d5f7-42bf-881d-eda94e78a00f tempest-GroupsTest-536896383 None] Group tempest-Group1-981149618: created successfully Apr 15 22:21:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-cfffea99-d5f7-42bf-881d-eda94e78a00f tempest-GroupsTest-536896383 None] Create group completed successfully. Apr 15 22:22:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-dc789faf-5cc3-4efd-9f66-01d34e6a64fe tempest-GroupsTest-536896383 None] Group tempest-Group2-1726755615: creating Apr 15 22:22:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-dc789faf-5cc3-4efd-9f66-01d34e6a64fe tempest-GroupsTest-536896383 None] Group tempest-Group2-1726755615: created successfully Apr 15 22:22:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-dc789faf-5cc3-4efd-9f66-01d34e6a64fe tempest-GroupsTest-536896383 None] Create group completed successfully. Apr 15 22:22:00 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Flow 'volume_create_manager' (2ab3c593-0cc4-44ef-bd99-13d8692412c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d72f04-5e30-4df9-bc5e-ecebfd2e5f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1d72f04-5e30-4df9-bc5e-ecebfd2e5f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1149332945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfd5845-c2b1-43e3-9928-5126e15d9608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6058bb718f4994bcf759631f4a77af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:01Z,use_quota=True,user_id='55718f4c1a46417d8131086c65f6613a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7060d717-f5e3-4f54-bb8c-1450468de244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7060d717-f5e3-4f54-bb8c-1450468de244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56805eef-2f49-4229-acf2-97649fc1cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56805eef-2f49-4229-acf2-97649fc1cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfd5845-c2b1-43e3-9928-5126e15d9608', 'volume_name': 'volume-3bfd5845-c2b1-43e3-9928-5126e15d9608', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0c9812-c2c0-4740-b3ec-f62c8725e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0c9812-c2c0-4740-b3ec-f62c8725e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5e1a7a-e376-4f09-b1d7-e2c51eb43f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Volume 3bfd5845-c2b1-43e3-9928-5126e15d9608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfd5845-c2b1-43e3-9928-5126e15d9608', 'volume_size': 1} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1149332945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfd5845-c2b1-43e3-9928-5126e15d9608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6058bb718f4994bcf759631f4a77af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:01Z,use_quota=True,user_id='55718f4c1a46417d8131086c65f6613a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Creating volume 3bfd5845-c2b1-43e3-9928-5126e15d9608 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:01 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:01 devstack sudo[85017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 1073741824 Apr 15 22:22:01 devstack sudo[85017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Flow 'volume_create_manager' (5160dc9f-e999-4974-8c27-426974999238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0e7321-c2cd-4cb9-9c8c-3f936704d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0e7321-c2cd-4cb9-9c8c-3f936704d904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2080634470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7f46545f6643eb8f1a6e68564cfaff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:01Z,use_quota=True,user_id='a51db0387a574b829a62207ff880282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(015723e4-787c-43ea-b43d-bfda14128271),volume_type_id=015723e4-787c-43ea-b43d-bfda14128271)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52efcee-6a97-489d-98cf-8d4f33126709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52efcee-6a97-489d-98cf-8d4f33126709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9f55ae-5ebb-447e-b0d5-a9c1c7258700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c9f55ae-5ebb-447e-b0d5-a9c1c7258700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7bf9eaf-b88b-4d5f-b204-90f4c4713e0b', 'volume_name': 'volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d9ec56-e6da-4d42-b2e3-4d0f1e973b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d9ec56-e6da-4d42-b2e3-4d0f1e973b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67dac231-fb1b-428e-b178-f21f8b5043f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:01 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Volume d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b', 'volume_size': 1} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:01 devstack sudo[85017]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 1073741824" returned: 0 in 0.691s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:01 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 Apr 15 22:22:01 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:01 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Flow 'volume_create_manager' (3cdc5f12-b434-4b8e-8b92-19b60fee6dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897beb80-eecf-48cf-a440-aa6bad6f068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897beb80-eecf-48cf-a440-aa6bad6f068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003625865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbb0a299-f8ce-48ab-be1c-8c1105d90793,host='devstack@QuobyteHD#QuobyteHD',id=2f41740a-96ad-41c0-9b55-b91e4d8bf5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0caa8950bf486b89354ed19abe1f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:02Z,use_quota=True,user_id='b1b173b1075142cf92af3587a570851c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32516207-ca76-488b-bf2d-f89a3c693a93),volume_type_id=32516207-ca76-488b-bf2d-f89a3c693a93)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99162fcd-e836-41d8-85d1-f3b8862328a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99162fcd-e836-41d8-85d1-f3b8862328a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfddfef6-4ec8-41e9-851b-03c9f30db46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfddfef6-4ec8-41e9-851b-03c9f30db46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f41740a-96ad-41c0-9b55-b91e4d8bf5ff', 'volume_name': 'volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b292fc-2c26-4c8b-82a8-6b65cff9f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b292fc-2c26-4c8b-82a8-6b65cff9f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358cab3-9542-4bf1-998d-f67893c9b206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:02 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Volume 2f41740a-96ad-41c0-9b55-b91e4d8bf5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff', 'volume_size': 1} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:02 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608" returned: 0 in 0.630s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2080634470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7f46545f6643eb8f1a6e68564cfaff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:01Z,use_quota=True,user_id='a51db0387a574b829a62207ff880282a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(015723e4-787c-43ea-b43d-bfda14128271),volume_type_id=015723e4-787c-43ea-b43d-bfda14128271)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Creating volume d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:02 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5e1a7a-e376-4f09-b1d7-e2c51eb43f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfd5845-c2b1-43e3-9928-5126e15d9608', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:02 devstack sudo[85055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b 1073741824 Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c46b28d-271b-4b6c-a666-379ee322b7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:02 devstack sudo[85055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:02 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Volume volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 (3bfd5845-c2b1-43e3-9928-5126e15d9608): created successfully Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c46b28d-271b-4b6c-a666-379ee322b7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Flow 'volume_create_manager' (2ab3c593-0cc4-44ef-bd99-13d8692412c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:02 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-96f7e4f3-cf98-467c-b190-0485c86ca73c tempest-AbsoluteLimitsTests-1346823727 None] Created volume successfully. Apr 15 22:22:02 devstack sudo[85055]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b 1073741824" returned: 0 in 0.518s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:02 devstack sudo[85060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b Apr 15 22:22:02 devstack sudo[85060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Acquiring lock "cinder-3bfd5845-c2b1-43e3-9928-5126e15d9608-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Lock "cinder-3bfd5845-c2b1-43e3-9928-5126e15d9608-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Acquiring lock "cinder-quobyte-3bfd5845-c2b1-43e3-9928-5126e15d9608" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Lock "cinder-quobyte-3bfd5845-c2b1-43e3-9928-5126e15d9608" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8125a70-4d50-4225-a251-38a9168959e1]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:03 devstack sudo[85060]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cbb0a299-f8ce-48ab-be1c-8c1105d90793,created_at=2026-04-15T20:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1003625865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cbb0a299-f8ce-48ab-be1c-8c1105d90793,host='devstack@QuobyteHD#QuobyteHD',id=2f41740a-96ad-41c0-9b55-b91e4d8bf5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0caa8950bf486b89354ed19abe1f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:02Z,use_quota=True,user_id='b1b173b1075142cf92af3587a570851c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32516207-ca76-488b-bf2d-f89a3c693a93),volume_type_id=32516207-ca76-488b-bf2d-f89a3c693a93)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Creating volume 2f41740a-96ad-41c0-9b55-b91e4d8bf5ff {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:03 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:03 devstack sudo[85064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff 1073741824 Apr 15 22:22:03 devstack sudo[85064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67dac231-fb1b-428e-b178-f21f8b5043f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de84855e-9830-4d94-83df-52c76bb999f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:03 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 Apr 15 22:22:03 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:03 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Volume volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b (d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b): created successfully Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de84855e-9830-4d94-83df-52c76bb999f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Flow 'volume_create_manager' (5160dc9f-e999-4974-8c27-426974999238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:03 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-7f7abd57-6be2-4d81-bec6-44f7b2334a56 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Created volume successfully. Apr 15 22:22:03 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608" returned: 0 in 0.533s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:03 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608 Apr 15 22:22:03 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:04 devstack sudo[85064]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff 1073741824" returned: 0 in 0.660s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:04 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff Apr 15 22:22:04 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:04 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3bfd5845-c2b1-43e3-9928-5126e15d9608" returned: 0 in 0.473s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Lock "cinder-quobyte-3bfd5845-c2b1-43e3-9928-5126e15d9608" released by "delete_volume" :: held 1.052s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Created reservations ['2af3c88c-fa52-44d8-ba1e-c95ca9e68357', '145a59bb-6de2-48b7-9b36-30a27ec607cb', '912f7b76-abf7-4800-ade9-79b47fa907c1', 'a6ba2799-1c71-4b29-a431-b1898f1451b5'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:04 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:04 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:04 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff" returned: 0 in 0.527s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358cab3-9542-4bf1-998d-f67893c9b206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae32bad-8562-4c56-bf3a-3a8da8290ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:04 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Volume volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff (2f41740a-96ad-41c0-9b55-b91e4d8bf5ff): created successfully Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae32bad-8562-4c56-bf3a-3a8da8290ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Flow 'volume_create_manager' (3cdc5f12-b434-4b8e-8b92-19b60fee6dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-188a1abc-76eb-4de8-8268-92a176131373 tempest-GroupsTest-536896383 None] Created volume successfully. Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:04 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:04 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:05 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.644s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:05 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Deleted volume successfully. Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-67ea8e91-aee4-4c57-b09b-09ce168d1169 tempest-AbsoluteLimitsTests-1346823727 None] Lock "cinder-3bfd5845-c2b1-43e3-9928-5126e15d9608-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:05 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.525s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:05 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-88151aa2-4baa-43f7-bb6d-f0d8ec8fe1f0 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Retype volume completed successfully. Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Acquiring lock "cinder-quobyte-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Lock "cinder-quobyte-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[588d7b0f-341b-4591-8a5e-af31924af756]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:05 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff Apr 15 22:22:05 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Acquiring lock "cinder-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "cinder-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:05 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=177,cinder:UPDATE=167,cinder:INSERT=45,cinder:DELETE=8 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Acquiring lock "cinder-quobyte-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "cinder-quobyte-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e1bf9-f901-41cd-b725-91b65d298600]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:06 devstack sudo[85119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b Apr 15 22:22:06 devstack sudo[85119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:06 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff" returned: 0 in 0.806s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:06 devstack sudo[85143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff Apr 15 22:22:06 devstack sudo[85143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:06 devstack sudo[85119]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b" returned: 0 in 0.719s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:06 devstack sudo[85150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b Apr 15 22:22:06 devstack sudo[85150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:07 devstack sudo[85143]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff" returned: 0 in 0.896s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Lock "cinder-quobyte-2f41740a-96ad-41c0-9b55-b91e4d8bf5ff" released by "delete_volume" :: held 1.733s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Created reservations ['d3aa4766-f756-451a-b5e4-affdb73bea88'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:07 devstack sudo[85150]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b" returned: 0 in 0.684s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:07 devstack cinder-volume[81921]: WARNING cinder.quota [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-39111508 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-39111508, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:07 devstack cinder-volume[81921]: WARNING cinder.quota [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-39111508 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-39111508, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Created reservations ['48dcbab5-0de1-403a-a69a-3941710867bc', 'fdf00bcd-61a2-44fd-8e00-c6e7c3ef1c8f', '74791616-8382-4f84-bba9-8004db1986be', '76e029cc-43c0-415a-bc77-1ff6b182ec86'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "cinder-quobyte-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b" released by "delete_volume" :: held 1.587s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:07 devstack cinder-volume[81921]: WARNING cinder.quota [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:07 devstack cinder-volume[81921]: WARNING cinder.quota [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Created reservations ['52ff204d-aa2d-4487-aa6c-531516f58f3b', 'e7f6bac5-5bf7-4e16-b8e3-abdfee09790b', '2884bdff-aab6-440a-aa58-818add7b5419', '9cadd3a4-ce92-4ee3-8397-cc3c86ddec69'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:07 devstack sudo[85210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:07 devstack sudo[85210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:07 devstack sudo[85212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:07 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Created reservations ['4c354457-97b5-43e9-b4d8-dd06b57454e0'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=223,cinder:SELECT=180,cinder:INSERT=44,cinder:DELETE=8 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:08 devstack sudo[85214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:08 devstack sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:08 devstack sudo[85210]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.498s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:08 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-987616f8-e7f8-41a6-afd4-1f081e1c21ee tempest-GroupsTest-536896383 None] Delete group completed successfully. Apr 15 22:22:08 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.595s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:08 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Deleted volume successfully. Apr 15 22:22:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5338a0e1-9376-4bf9-9fe8-9c91f3a4e1b8 tempest-VolumeRetypeWithoutMigrationTest-1223317681 None] Lock "cinder-d7bf9eaf-b88b-4d5f-b204-90f4c4713e0b-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:08 devstack sudo[85214]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.589s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:08 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5f95b023-f8e8-4b3d-97a5-4706f8e354a7 tempest-GroupsTest-536896383 None] Delete group completed successfully. Apr 15 22:22:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-48d88da8-0f09-48d7-b75a-62dc5ee2dd63 tempest-GroupsTest-536896383 None] Group tempest-GroupsTest-Group-1639941483: creating Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Flow 'volume_create_manager' (d2bde417-2cab-4204-83d4-4b29a13d40f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbf4346-c2d5-41e8-acd5-f601a664bab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbf4346-c2d5-41e8-acd5-f601a664bab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2114769609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a624a7b8-e49c-4d73-a311-22cb7166b13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c831c24e4c53438b8454edc194aa0272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:10Z,use_quota=True,user_id='468b8ef4b9874a53bf300b0800cbc673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d41587-f890-468e-8334-79fb700f45a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4d41587-f890-468e-8334-79fb700f45a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7557d48-93f3-42f5-8e0a-022a8d1b8a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7557d48-93f3-42f5-8e0a-022a8d1b8a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a624a7b8-e49c-4d73-a311-22cb7166b13a', 'volume_name': 'volume-a624a7b8-e49c-4d73-a311-22cb7166b13a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b87c5a-e7da-4912-b498-ae527501b9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b87c5a-e7da-4912-b498-ae527501b9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb30b7f7-d3dd-4d39-94b5-b1f5e91259a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:09 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Volume a624a7b8-e49c-4d73-a311-22cb7166b13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a624a7b8-e49c-4d73-a311-22cb7166b13a', 'volume_size': 1} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2114769609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a624a7b8-e49c-4d73-a311-22cb7166b13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c831c24e4c53438b8454edc194aa0272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:10Z,use_quota=True,user_id='468b8ef4b9874a53bf300b0800cbc673',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Creating volume a624a7b8-e49c-4d73-a311-22cb7166b13a {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:09 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-48d88da8-0f09-48d7-b75a-62dc5ee2dd63 tempest-GroupsTest-536896383 None] Group tempest-GroupsTest-Group-1639941483: created successfully Apr 15 22:22:09 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a 1073741824 Apr 15 22:22:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-48d88da8-0f09-48d7-b75a-62dc5ee2dd63 tempest-GroupsTest-536896383 None] Create group completed successfully. Apr 15 22:22:09 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:10 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a 1073741824" returned: 0 in 0.606s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:10 devstack sudo[85230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a Apr 15 22:22:10 devstack sudo[85230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:10 devstack sudo[85230]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a" returned: 0 in 0.509s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb30b7f7-d3dd-4d39-94b5-b1f5e91259a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a624a7b8-e49c-4d73-a311-22cb7166b13a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355fd909-9304-4236-a11d-ca3dcb90d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Volume volume-a624a7b8-e49c-4d73-a311-22cb7166b13a (a624a7b8-e49c-4d73-a311-22cb7166b13a): created successfully Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355fd909-9304-4236-a11d-ca3dcb90d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Flow 'volume_create_manager' (d2bde417-2cab-4204-83d4-4b29a13d40f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:10 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b6ed6da1-c9e1-4f7e-a2c3-000d3de84032 tempest-VolumesMetadataTest-781661056 None] Created volume successfully. Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Flow 'volume_create_manager' (64987fbe-3db5-45ea-94fb-a021bbf92ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d2543b-cf7e-46ee-925c-047f8c281295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d2543b-cf7e-46ee-925c-047f8c281295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-312906467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb66b442-5c82-499e-b1c4-5f004c8f5ab0,host='devstack@QuobyteHD#QuobyteHD',id=84cbdac7-bae3-474a-af73-f4e271c38383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0caa8950bf486b89354ed19abe1f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:11Z,use_quota=True,user_id='b1b173b1075142cf92af3587a570851c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c),volume_type_id=1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2553cdff-7e8b-4ec7-bed7-0b67ba2f662d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2553cdff-7e8b-4ec7-bed7-0b67ba2f662d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e8e7b-0ed0-4f55-930f-45dc93725a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554e8e7b-0ed0-4f55-930f-45dc93725a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cbdac7-bae3-474a-af73-f4e271c38383', 'volume_name': 'volume-84cbdac7-bae3-474a-af73-f4e271c38383', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae655c4-bd70-4b5e-b01e-a9786d7d3d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae655c4-bd70-4b5e-b01e-a9786d7d3d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385f1b89-b0ac-4e95-bf6b-66da747fd824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Volume 84cbdac7-bae3-474a-af73-f4e271c38383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cbdac7-bae3-474a-af73-f4e271c38383', 'volume_size': 1} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb66b442-5c82-499e-b1c4-5f004c8f5ab0,created_at=2026-04-15T20:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-312906467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb66b442-5c82-499e-b1c4-5f004c8f5ab0,host='devstack@QuobyteHD#QuobyteHD',id=84cbdac7-bae3-474a-af73-f4e271c38383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0caa8950bf486b89354ed19abe1f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:11Z,use_quota=True,user_id='b1b173b1075142cf92af3587a570851c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c),volume_type_id=1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Creating volume 84cbdac7-bae3-474a-af73-f4e271c38383 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:10 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:11 devstack sudo[85235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 1073741824 Apr 15 22:22:11 devstack sudo[85235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:11 devstack sudo[85235]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 1073741824" returned: 0 in 0.579s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:11 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 Apr 15 22:22:11 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:12 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383" returned: 0 in 0.545s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385f1b89-b0ac-4e95-bf6b-66da747fd824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cbdac7-bae3-474a-af73-f4e271c38383', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61e4ec8-c489-409e-9f47-51354f3c41ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:12 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Volume volume-84cbdac7-bae3-474a-af73-f4e271c38383 (84cbdac7-bae3-474a-af73-f4e271c38383): created successfully Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61e4ec8-c489-409e-9f47-51354f3c41ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Flow 'volume_create_manager' (64987fbe-3db5-45ea-94fb-a021bbf92ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:12 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-7a98bf69-7433-48ec-a00c-4ca8c442591f tempest-GroupsTest-536896383 None] Created volume successfully. Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Acquiring lock "cinder-a624a7b8-e49c-4d73-a311-22cb7166b13a-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Lock "cinder-a624a7b8-e49c-4d73-a311-22cb7166b13a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Acquiring lock "cinder-quobyte-a624a7b8-e49c-4d73-a311-22cb7166b13a" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Lock "cinder-quobyte-a624a7b8-e49c-4d73-a311-22cb7166b13a" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b725f05c-3b44-4afe-a9fb-bf45469a9afa]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:12 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a Apr 15 22:22:12 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:12 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:12 devstack sudo[85249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a Apr 15 22:22:12 devstack sudo[85249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:13 devstack sudo[85249]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a624a7b8-e49c-4d73-a311-22cb7166b13a" returned: 0 in 0.566s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Lock "cinder-quobyte-a624a7b8-e49c-4d73-a311-22cb7166b13a" released by "delete_volume" :: held 1.140s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Created reservations ['11b83ef3-a99a-49ff-9284-31845bf0f760', '6e55b41c-c0ca-457f-94fa-b6fe4f6242f8', 'd3619d98-f8d2-492a-b5c7-312b1dc526c3', '9222aba0-4c70-4a5b-a8cb-1598a6261829'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:13 devstack sudo[85253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:13 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Flow 'volume_create_manager' (7948c9f6-c250-41a2-b3b3-a9f549e4a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76e82ab-625a-4a08-a046-e4e235355034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f76e82ab-625a-4a08-a046-e4e235355034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-628523212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb66b442-5c82-499e-b1c4-5f004c8f5ab0,host='devstack@QuobyteHD#QuobyteHD',id=ded121e5-30a9-4c4e-8385-9adbb73528d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0caa8950bf486b89354ed19abe1f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:13Z,use_quota=True,user_id='b1b173b1075142cf92af3587a570851c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c),volume_type_id=1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2dbf15-b449-496e-b788-d98053f28a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af2dbf15-b449-496e-b788-d98053f28a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc615342-2e70-453d-a578-60dea4cd5b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc615342-2e70-453d-a578-60dea4cd5b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded121e5-30a9-4c4e-8385-9adbb73528d5', 'volume_name': 'volume-ded121e5-30a9-4c4e-8385-9adbb73528d5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1f095b-df69-49fa-91f4-731f23c404bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1f095b-df69-49fa-91f4-731f23c404bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c89570-9225-4e68-b88d-b97e6ff0101f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:13 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Volume ded121e5-30a9-4c4e-8385-9adbb73528d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded121e5-30a9-4c4e-8385-9adbb73528d5', 'volume_size': 1} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fb66b442-5c82-499e-b1c4-5f004c8f5ab0,created_at=2026-04-15T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-628523212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fb66b442-5c82-499e-b1c4-5f004c8f5ab0,host='devstack@QuobyteHD#QuobyteHD',id=ded121e5-30a9-4c4e-8385-9adbb73528d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0caa8950bf486b89354ed19abe1f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:13Z,use_quota=True,user_id='b1b173b1075142cf92af3587a570851c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c),volume_type_id=1399a7ab-dcc2-4ce5-871a-bc7cf8a7290c)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Creating volume ded121e5-30a9-4c4e-8385-9adbb73528d5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:13 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:13 devstack sudo[85255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 1073741824 Apr 15 22:22:13 devstack sudo[85255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:14 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.542s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Deleted volume successfully. Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8c695bd9-d935-4948-8203-8033091b84c1 tempest-VolumesMetadataTest-781661056 None] Lock "cinder-a624a7b8-e49c-4d73-a311-22cb7166b13a-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:14 devstack sudo[85255]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 1073741824" returned: 0 in 0.565s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:14 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 Apr 15 22:22:14 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:14 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5" returned: 0 in 0.584s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c89570-9225-4e68-b88d-b97e6ff0101f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded121e5-30a9-4c4e-8385-9adbb73528d5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbec19e-265c-44c7-a09d-cda6f5db4d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:14 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Volume volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 (ded121e5-30a9-4c4e-8385-9adbb73528d5): created successfully Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbec19e-265c-44c7-a09d-cda6f5db4d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Flow 'volume_create_manager' (7948c9f6-c250-41a2-b3b3-a9f549e4a31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fd6e95c8-cf95-4749-b28e-06cb2a7d3303 tempest-GroupsTest-536896383 None] Created volume successfully. Apr 15 22:22:15 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-00658821-ff13-498b-8dfe-08797d739502 tempest-GroupsTest-536896383 None] Update group completed successfully. Apr 15 22:22:17 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-007e3af6-3657-4710-977e-bd7f338feac3 tempest-GroupsTest-536896383 None] Update group completed successfully. Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:17 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:17 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:17 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.542s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:17 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Acquiring lock "cinder-quobyte-84cbdac7-bae3-474a-af73-f4e271c38383" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Lock "cinder-quobyte-84cbdac7-bae3-474a-af73-f4e271c38383" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:18 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a3080-8ea1-4dfa-beb2-b08f6abee816]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:18 devstack sudo[85291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 Apr 15 22:22:18 devstack sudo[85291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:19 devstack sudo[85291]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383" returned: 0 in 0.629s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:19 devstack sudo[85296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383 Apr 15 22:22:19 devstack sudo[85296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:19 devstack sudo[85296]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84cbdac7-bae3-474a-af73-f4e271c38383" returned: 0 in 0.508s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Lock "cinder-quobyte-84cbdac7-bae3-474a-af73-f4e271c38383" released by "delete_volume" :: held 1.162s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Acquiring lock "cinder-quobyte-ded121e5-30a9-4c4e-8385-9adbb73528d5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Lock "cinder-quobyte-ded121e5-30a9-4c4e-8385-9adbb73528d5" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[495c73f1-8263-4d87-a81c-4bf214be0487]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:19 devstack sudo[85302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 Apr 15 22:22:19 devstack sudo[85302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:20 devstack sudo[85302]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5" returned: 0 in 0.604s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:20 devstack sudo[85307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5 Apr 15 22:22:20 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:20 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ded121e5-30a9-4c4e-8385-9adbb73528d5" returned: 0 in 0.482s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Lock "cinder-quobyte-ded121e5-30a9-4c4e-8385-9adbb73528d5" released by "delete_volume" :: held 1.112s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:20 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Created reservations ['c7fe8ce9-b599-4f18-a27c-c857ae0c06d1'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:20 devstack cinder-volume[81921]: WARNING cinder.quota [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-919621333 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-919621333, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:20 devstack cinder-volume[81921]: WARNING cinder.quota [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-919621333 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-919621333, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:20 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Created reservations ['a7537bf8-2039-47be-9dab-cd75fd0c3422', '0df6e89a-01bb-4084-ab5f-c8bec753f0d2', 'da4a9c75-84c6-43db-85da-c2e74a5d188c', 'b0463ffe-2802-4a41-84c6-dceabdbde97e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Created reservations ['6e9f361d-1c57-4fd3-ae22-4ceb0a8ba1d0', '07a7cb85-079b-4d0b-a19f-4cfd3b846b68', '40990843-57db-41e0-a391-5f0afc5c044f', '86fc080e-c7a1-4684-911c-bcfe30ccfaf2'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:21 devstack sudo[85310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:21 devstack sudo[85310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:21 devstack sudo[85310]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.685s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:21 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:21 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ee22e6d9-efd8-422a-b7a1-3c2444c2bbf2 tempest-GroupsTest-536896383 None] Delete group completed successfully. Apr 15 22:22:23 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Flow 'volume_create_manager' (6ea17807-e713-49d2-95a1-d44c9f425b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0961a858-b9e6-46cd-b463-1e4bfd938af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0961a858-b9e6-46cd-b463-1e4bfd938af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602637987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89512d91-5ab7-481c-8724-a841e5a39908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3337a68a54c69bea75cbcbab01262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:24Z,use_quota=True,user_id='2a54583129a44e508ecd96a2e0aa7b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584bc64-2d1f-4390-b2aa-3138c2881627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4584bc64-2d1f-4390-b2aa-3138c2881627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa04776f-0481-440e-9d69-b1f86cda1431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa04776f-0481-440e-9d69-b1f86cda1431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89512d91-5ab7-481c-8724-a841e5a39908', 'volume_name': 'volume-89512d91-5ab7-481c-8724-a841e5a39908', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c157b0-c0e9-4161-82be-e3b6bc74b3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c157b0-c0e9-4161-82be-e3b6bc74b3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4a76f7-df7a-4218-b1f1-f92f4f551daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:24 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Volume 89512d91-5ab7-481c-8724-a841e5a39908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89512d91-5ab7-481c-8724-a841e5a39908', 'volume_size': 1} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-602637987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89512d91-5ab7-481c-8724-a841e5a39908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3337a68a54c69bea75cbcbab01262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:24Z,use_quota=True,user_id='2a54583129a44e508ecd96a2e0aa7b26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Creating volume 89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:24 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:24 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 1073741824 Apr 15 22:22:24 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:25 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 1073741824" returned: 0 in 0.960s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:25 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:22:25 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:25 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.737s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4a76f7-df7a-4218-b1f1-f92f4f551daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89512d91-5ab7-481c-8724-a841e5a39908', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9b6246-f436-4df3-9889-2c2ee2bb0673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:25 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Volume volume-89512d91-5ab7-481c-8724-a841e5a39908 (89512d91-5ab7-481c-8724-a841e5a39908): created successfully Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9b6246-f436-4df3-9889-2c2ee2bb0673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Flow 'volume_create_manager' (6ea17807-e713-49d2-95a1-d44c9f425b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:25 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e1a6c6cf-7594-45a5-af30-ec082900e9df tempest-VolumesActionsTest-518524336 None] Created volume successfully. Apr 15 22:22:35 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:DELETE=2,cinder:SELECT=30,cinder:UPDATE=37,cinder:INSERT=11 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:22:35 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=55,cinder:UPDATE=67,cinder:INSERT=11,cinder:DELETE=4 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Flow 'volume_create_manager' (fb21ca79-11b1-4d8c-8d64-4db903be4771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ca98d8-1c83-48b6-90b7-a10e2e8e8fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ca98d8-1c83-48b6-90b7-a10e2e8e8fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-496055403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bb7056-818d-44aa-99ac-5de0ebc13731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faa3e03bc714bf9824821857382e862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:37Z,use_quota=True,user_id='11b86113ca054585a2368aa6b79266c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b69313-c521-4927-a25a-bd9ad665eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b69313-c521-4927-a25a-bd9ad665eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19415403-86b3-4c80-9be4-09933b350806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19415403-86b3-4c80-9be4-09933b350806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bb7056-818d-44aa-99ac-5de0ebc13731', 'volume_name': 'volume-74bb7056-818d-44aa-99ac-5de0ebc13731', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebdffd1-2d8f-43fc-8f73-da153fbbe54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ebdffd1-2d8f-43fc-8f73-da153fbbe54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608804c7-b8b0-4e7e-8b5e-0690bda139a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:37 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Volume 74bb7056-818d-44aa-99ac-5de0ebc13731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bb7056-818d-44aa-99ac-5de0ebc13731', 'volume_size': 1} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-496055403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bb7056-818d-44aa-99ac-5de0ebc13731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8faa3e03bc714bf9824821857382e862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:37Z,use_quota=True,user_id='11b86113ca054585a2368aa6b79266c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Creating volume 74bb7056-818d-44aa-99ac-5de0ebc13731 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:37 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:37 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 1073741824 Apr 15 22:22:37 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:38 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 1073741824" returned: 0 in 0.904s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:38 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 Apr 15 22:22:38 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:38 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731" returned: 0 in 0.667s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608804c7-b8b0-4e7e-8b5e-0690bda139a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bb7056-818d-44aa-99ac-5de0ebc13731', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f14bbc-cd34-4a43-a521-4d391c45463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:38 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Volume volume-74bb7056-818d-44aa-99ac-5de0ebc13731 (74bb7056-818d-44aa-99ac-5de0ebc13731): created successfully Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f14bbc-cd34-4a43-a521-4d391c45463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Flow 'volume_create_manager' (fb21ca79-11b1-4d8c-8d64-4db903be4771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-cb4465f7-0393-4deb-9ea4-a0c26697809e tempest-VolumesServicesTestJSON-823176232 None] Created volume successfully. Apr 15 22:22:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Acquiring lock "cinder-74bb7056-818d-44aa-99ac-5de0ebc13731-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Lock "cinder-74bb7056-818d-44aa-99ac-5de0ebc13731-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Acquiring lock "cinder-quobyte-74bb7056-818d-44aa-99ac-5de0ebc13731" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Lock "cinder-quobyte-74bb7056-818d-44aa-99ac-5de0ebc13731" acquired by "delete_volume" :: waited 0.019s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:40 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c574d87b-54fb-4ecf-89a2-ace4c41d32ec]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:40 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 Apr 15 22:22:40 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:41 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731" returned: 0 in 1.658s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:41 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731 Apr 15 22:22:41 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-74e2da03-ac49-44ab-b7a3-e689312a4a0a tempest-VolumesActionsTest-518524336 None] Acquiring lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908" by "attach_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-74e2da03-ac49-44ab-b7a3-e689312a4a0a tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908" acquired by "attach_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-74e2da03-ac49-44ab-b7a3-e689312a4a0a tempest-VolumesActionsTest-518524336 None] Attaching volume 89512d91-5ab7-481c-8724-a841e5a39908 to instance 19033a14-643c-4d8f-b1b4-80051f4c38f1 at mountpoint /dev/vdb on host None. Apr 15 22:22:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-74e2da03-ac49-44ab-b7a3-e689312a4a0a tempest-VolumesActionsTest-518524336 None] Attach volume completed successfully. Apr 15 22:22:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-74e2da03-ac49-44ab-b7a3-e689312a4a0a tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908" released by "attach_volume" :: held 0.343s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a9edeaaa-26b4-4584-b59e-55f4a03094c4 tempest-VolumesActionsTest-518524336 None] Acquiring lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-detach_volume" by "detach_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a9edeaaa-26b4-4584-b59e-55f4a03094c4 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a9edeaaa-26b4-4584-b59e-55f4a03094c4 tempest-VolumesActionsTest-518524336 None] Detaching volume 89512d91-5ab7-481c-8724-a841e5a39908 from instance 19033a14-643c-4d8f-b1b4-80051f4c38f1. Apr 15 22:22:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a9edeaaa-26b4-4584-b59e-55f4a03094c4 tempest-VolumesActionsTest-518524336 None] Detach volume completed successfully. Apr 15 22:22:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a9edeaaa-26b4-4584-b59e-55f4a03094c4 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-detach_volume" released by "detach_volume" :: held 0.187s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:43 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-74bb7056-818d-44aa-99ac-5de0ebc13731" returned: 0 in 1.426s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Lock "cinder-quobyte-74bb7056-818d-44aa-99ac-5de0ebc13731" released by "delete_volume" :: held 3.182s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Created reservations ['22efc448-45f6-4e8e-a9e2-28dba87a7f7a', 'a7894b29-6340-48c3-9288-255f7061beb1', '4c5050fb-3840-475d-835a-29abd0b2637b', 'd7c98e4e-572d-42fd-8498-2421a0b9790f'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:43 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:43 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Flow 'volume_create_manager' (7af53ecc-20fb-47c4-95f6-3c41af5dc0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7164f807-44f5-4203-b345-f6afa68c7e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7164f807-44f5-4203-b345-f6afa68c7e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949f40b1-f80e-4a69-aa66-87d66d612ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baa72c426744120bb901c9368348a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:44Z,use_quota=True,user_id='078750a0453c471e98962b718909c200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25aa09db-d66a-4f93-94a7-e0f603c04431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25aa09db-d66a-4f93-94a7-e0f603c04431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832b035f-1108-4254-8293-106b0c9bd8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.image.glance [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Creating Keystone auth plugin from conf {{(pid=81921) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 22:22:44 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 1.265s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:44 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Deleted volume successfully. Apr 15 22:22:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fa4e35d9-33d1-463a-bc40-56b695f075c0 tempest-VolumesServicesTestJSON-823176232 None] Lock "cinder-74bb7056-818d-44aa-99ac-5de0ebc13731-delete_volume" released by "delete_volume" :: held 4.807s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832b035f-1108-4254-8293-106b0c9bd8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '949f40b1-f80e-4a69-aa66-87d66d612ef4', 'volume_name': 'volume-949f40b1-f80e-4a69-aa66-87d66d612ef4', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e95b9c1-3259-4d76-981c-c8139d8e6dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e95b9c1-3259-4d76-981c-c8139d8e6dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b8e9b0-8708-43e2-bacc-6254a5d595c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:45 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Volume 949f40b1-f80e-4a69-aa66-87d66d612ef4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-949f40b1-f80e-4a69-aa66-87d66d612ef4', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Trying to clone 949f40b1-f80e-4a69-aa66-87d66d612ef4 from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]). {{(pid=81921) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 22:22:45 devstack cinder-volume[81921]: INFO cinder.image.image_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Image download 20.69 MB at 20.69 MB/s Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[362d040e-1040-4891-a39f-43907783e7a8]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:45 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD Apr 15 22:22:45 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:46 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:46 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd is fetched for user 078750a0453c471e98962b718909c200. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 22:22:46 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b284cb1-9010-4b84-b331-40059a9e1dda]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:46 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD Apr 15 22:22:46 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:47 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD" returned: 0 in 0.668s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949f40b1-f80e-4a69-aa66-87d66d612ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8baa72c426744120bb901c9368348a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:44Z,use_quota=True,user_id='078750a0453c471e98962b718909c200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Creating volume 949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:47 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:47 devstack sudo[85559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 1073741824 Apr 15 22:22:47 devstack sudo[85559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:48 devstack sudo[85559]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 1073741824" returned: 0 in 0.826s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:48 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:22:48 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:48 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 0 in 0.730s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:48 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Attempting download of 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume 949f40b1-f80e-4a69-aa66-87d66d612ef4. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 22:22:49 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[faafbe0d-a26f-4b59-87b6-1d79e8c67749]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_9hiki1wb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:49 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_9hiki1wb Apr 15 22:22:49 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:49 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_9hiki1wb" returned: 0 in 0.752s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_9hiki1wb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:49 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_9hiki1wb Apr 15 22:22:49 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:50 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_9hiki1wb" returned: 1 in 0.693s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_9hiki1wb' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:22:50 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e38fcdb-f89d-416b-ad45-ca1b09713d6a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:50 devstack sudo[85577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD Apr 15 22:22:50 devstack sudo[85577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:51 devstack sudo[85577]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:51 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd was qcow2, converting to raw {{(pid=81921) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 22:22:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:51 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:22:51 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:52 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 0 in 1.652s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:52 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_ggexjtdzdevstack@QuobyteHD, size 112.00 MB, duration 1.66 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:22:52 devstack cinder-volume[81921]: INFO cinder.image.image_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Converted 112.00 MB image at 67.64 MB/s Apr 15 22:22:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:52 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 1G Apr 15 22:22:52 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:53 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 1G" returned: 0 in 0.588s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:53 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b5af73-1581-4037-9d5b-552b884407b4]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:53 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:22:53 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Flow 'volume_create_manager' (709c06e4-dd9d-45d7-8a9d-6d69ab8fd336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83101738-2e8d-4b57-9b6a-df563dd870d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83101738-2e8d-4b57-9b6a-df563dd870d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-803930843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd261329-8f08-4985-be26-4559b97f2e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8242248e93420899e337e244c7e25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:54Z,use_quota=True,user_id='b601bec4e3d046deb8facf8f10090fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfbc587a-bbb1-40c1-a5f4-3ea39fc632cf),volume_type_id=dfbc587a-bbb1-40c1-a5f4-3ea39fc632cf)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972e68c0-c789-4bc9-b1aa-4324ca8d3b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972e68c0-c789-4bc9-b1aa-4324ca8d3b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c99773-6fda-45b4-b725-ca45bf1190cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c99773-6fda-45b4-b725-ca45bf1190cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd261329-8f08-4985-be26-4559b97f2e35', 'volume_name': 'volume-dd261329-8f08-4985-be26-4559b97f2e35', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c4e929-b4bb-4f20-9009-9ffe184a7d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c4e929-b4bb-4f20-9009-9ffe184a7d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:54 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcf1fa8-dc8a-4c35-8437-09fd7d9fdbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:54 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Volume dd261329-8f08-4985-be26-4559b97f2e35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd261329-8f08-4985-be26-4559b97f2e35', 'volume_size': 1} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-803930843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd261329-8f08-4985-be26-4559b97f2e35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8242248e93420899e337e244c7e25a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:22:54Z,use_quota=True,user_id='b601bec4e3d046deb8facf8f10090fc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dfbc587a-bbb1-40c1-a5f4-3ea39fc632cf),volume_type_id=dfbc587a-bbb1-40c1-a5f4-3ea39fc632cf)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Creating volume dd261329-8f08-4985-be26-4559b97f2e35 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:22:54 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 0 in 0.755s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:54 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 1073741824 Apr 15 22:22:54 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:54 devstack sudo[85623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:22:54 devstack sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:54 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 1073741824" returned: 0 in 0.570s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:54 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 Apr 15 22:22:54 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:54 devstack sudo[85623]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 1 in 0.612s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Downloaded image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume 949f40b1-f80e-4a69-aa66-87d66d612ef4 successfully. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd for user 078750a0453c471e98962b718909c200 is deleted. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 22:22:54 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Marking volume 949f40b1-f80e-4a69-aa66-87d66d612ef4 as bootable. {{(pid=81921) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Copying metadata from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd to 949f40b1-f80e-4a69-aa66-87d66d612ef4. {{(pid=81921) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Creating volume glance metadata for volume 949f40b1-f80e-4a69-aa66-87d66d612ef4 backed by image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81921) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b8e9b0-8708-43e2-bacc-6254a5d595c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949f40b1-f80e-4a69-aa66-87d66d612ef4', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f062e552-ebfa-474b-9791-f0a9711e83e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:55 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Volume volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 (949f40b1-f80e-4a69-aa66-87d66d612ef4): created successfully Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f062e552-ebfa-474b-9791-f0a9711e83e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Flow 'volume_create_manager' (7af53ecc-20fb-47c4-95f6-3c41af5dc0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-bba0d5d6-17c5-4a57-a12c-d09b62fb6ace tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Created volume successfully. Apr 15 22:22:55 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcf1fa8-dc8a-4c35-8437-09fd7d9fdbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd261329-8f08-4985-be26-4559b97f2e35', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249f75d1-de91-47fb-a337-9f6fefe448d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:22:55 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Volume volume-dd261329-8f08-4985-be26-4559b97f2e35 (dd261329-8f08-4985-be26-4559b97f2e35): created successfully Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249f75d1-de91-47fb-a337-9f6fefe448d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:22:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Flow 'volume_create_manager' (709c06e4-dd9d-45d7-8a9d-6d69ab8fd336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:22:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-28da944b-13f4-4841-b87d-a120bfa8b8d5 tempest-VolumeTypesAccessTest-111767539 None] Created volume successfully. Apr 15 22:22:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Acquiring lock "cinder-dd261329-8f08-4985-be26-4559b97f2e35-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Lock "cinder-dd261329-8f08-4985-be26-4559b97f2e35-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Acquiring lock "cinder-quobyte-dd261329-8f08-4985-be26-4559b97f2e35" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:22:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Lock "cinder-quobyte-dd261329-8f08-4985-be26-4559b97f2e35" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:22:56 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42bdd3e-2574-4eec-9963-47a393aa0215]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:56 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 Apr 15 22:22:56 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:57 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[382e2263-2f2f-48ba-bd0f-8afba577b7db]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:22:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:57 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35" returned: 0 in 0.967s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:57 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:22:57 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:57 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35 Apr 15 22:22:57 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:58 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:58 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dd261329-8f08-4985-be26-4559b97f2e35" returned: 0 in 1.195s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 0 in 1.369s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Lock "cinder-quobyte-dd261329-8f08-4985-be26-4559b97f2e35" released by "delete_volume" :: held 2.209s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:22:58 devstack cinder-volume[81921]: WARNING cinder.quota [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-571341974 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-571341974, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:58 devstack cinder-volume[81921]: WARNING cinder.quota [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-571341974 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-571341974, it is now deprecated. Please use the default quota class for default quota. Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Created reservations ['3e3fe02d-b160-4a19-983d-ec275a873eaf', '752c15df-103e-4b12-9905-90716297c0f5', 'e2bfdd13-40f0-4996-838a-cbeff6f6ef81', 'd8ef902d-e49b-40f2-94d7-6339ae3cd232'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:22:58 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:22:58 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:22:58 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:22:58 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:22:59 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 1 in 0.764s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:22:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.182s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:22:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6', 'name': 'volume-949f40b1-f80e-4a69-aa66-87d66d612ef4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '954b0979-f678-44b1-b04f-3190cbfbd221', 'enforce_multipath': True} {{(pid=81921) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 22:22:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-48c79453-ff10-43f6-90f3-49a877247769 req-ef09c061-f031-4164-9fb2-a50c5c17c1b7 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] attachment_update completed successfully. Apr 15 22:22:59 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 15 22:22:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.668s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:22:59 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:22:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Deleted volume successfully. Apr 15 22:22:59 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1f86a542-0df0-432d-ae79-3d76464dc0d4 tempest-VolumeTypesAccessTest-111767539 None] Lock "cinder-dd261329-8f08-4985-be26-4559b97f2e35-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (a806224c-8334-4af9-919f-1bd80c3afb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2759235-bac8-499d-a48d-9ad3c5230390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2759235-bac8-499d-a48d-9ad3c5230390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1639929002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66db4bfa-2b7a-4220-8940-1680bd5d9ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:00Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8c95d0-6d74-41ff-90a9-336f33aa5770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8c95d0-6d74-41ff-90a9-336f33aa5770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b78c6c-0ae8-46b6-b2d1-6339aafd15c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b78c6c-0ae8-46b6-b2d1-6339aafd15c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66db4bfa-2b7a-4220-8940-1680bd5d9ca5', 'volume_name': 'volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866bdbda-6ed7-4b5d-8384-d01f73a0730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866bdbda-6ed7-4b5d-8384-d01f73a0730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1135e11-2ab7-420a-898e-b2d152d35543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:00 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Volume 66db4bfa-2b7a-4220-8940-1680bd5d9ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5', 'volume_size': 1} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1639929002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66db4bfa-2b7a-4220-8940-1680bd5d9ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:00Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Creating volume 66db4bfa-2b7a-4220-8940-1680bd5d9ca5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:00 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:00 devstack sudo[85716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 1073741824 Apr 15 22:23:00 devstack sudo[85716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:01 devstack sudo[85716]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 1073741824" returned: 0 in 0.707s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:01 devstack sudo[85724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 Apr 15 22:23:01 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:01 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" returned: 0 in 0.639s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1135e11-2ab7-420a-898e-b2d152d35543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd867a37-2339-42c9-9743-66a7a2138bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:01 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Volume volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 (66db4bfa-2b7a-4220-8940-1680bd5d9ca5): created successfully Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd867a37-2339-42c9-9743-66a7a2138bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (a806224c-8334-4af9-919f-1bd80c3afb49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:01 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fa14ab24-fc5d-4189-8d2b-e5d6caa478cc tempest-VolumesActionsTest-635647250 None] Created volume successfully. Apr 15 22:23:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-98651120-55a9-4d02-9ecc-74d25817035b tempest-VolumesActionsTest-635647250 None] Acquiring lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" by "attach_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-98651120-55a9-4d02-9ecc-74d25817035b tempest-VolumesActionsTest-635647250 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" acquired by "attach_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:02 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-98651120-55a9-4d02-9ecc-74d25817035b tempest-VolumesActionsTest-635647250 None] Attaching volume 66db4bfa-2b7a-4220-8940-1680bd5d9ca5 to instance 9775dbe7-8047-46f9-8677-1b5567fdda52 at mountpoint /dev/vdb on host None. Apr 15 22:23:02 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-98651120-55a9-4d02-9ecc-74d25817035b tempest-VolumesActionsTest-635647250 None] Attach volume completed successfully. Apr 15 22:23:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-98651120-55a9-4d02-9ecc-74d25817035b tempest-VolumesActionsTest-635647250 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" released by "attach_volume" :: held 0.139s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:03 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-42632af5-5025-4055-8cf2-e2dbb73632de tempest-VolumesActionsTest-761388560 None] Terminate volume connection completed successfully. Apr 15 22:23:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-42632af5-5025-4055-8cf2-e2dbb73632de tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-detach_volume" by "detach_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-42632af5-5025-4055-8cf2-e2dbb73632de tempest-VolumesActionsTest-761388560 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-42632af5-5025-4055-8cf2-e2dbb73632de tempest-VolumesActionsTest-761388560 None] Detaching volume 66db4bfa-2b7a-4220-8940-1680bd5d9ca5 from instance 9775dbe7-8047-46f9-8677-1b5567fdda52. Apr 15 22:23:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-42632af5-5025-4055-8cf2-e2dbb73632de tempest-VolumesActionsTest-761388560 None] Detach volume completed successfully. Apr 15 22:23:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-42632af5-5025-4055-8cf2-e2dbb73632de tempest-VolumesActionsTest-761388560 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-detach_volume" released by "detach_volume" :: held 0.075s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7b2c847e-9183-4fb5-ac6b-dbe316fe19af tempest-VolumesActionsTest-635647250 None] Acquiring lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-detach_volume" by "detach_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7b2c847e-9183-4fb5-ac6b-dbe316fe19af tempest-VolumesActionsTest-635647250 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-7b2c847e-9183-4fb5-ac6b-dbe316fe19af tempest-VolumesActionsTest-635647250 None] Volume detach called, but volume not attached. Apr 15 22:23:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7b2c847e-9183-4fb5-ac6b-dbe316fe19af tempest-VolumesActionsTest-635647250 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Acquiring lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Acquiring lock "cinder-quobyte-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Lock "cinder-quobyte-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:06 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0058ca-b9c8-4594-a963-44b4a8a5fbf5]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:06 devstack sudo[85801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 Apr 15 22:23:06 devstack sudo[85801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:07 devstack sudo[85801]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" returned: 0 in 1.316s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:07 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5 Apr 15 22:23:07 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5d7f06e0-e153-4288-b0f4-a7d7e3edc824 tempest-VolumesActionsTest-518524336 None] Acquiring lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908" by "attach_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5d7f06e0-e153-4288-b0f4-a7d7e3edc824 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908" acquired by "attach_volume" :: waited 0.029s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5d7f06e0-e153-4288-b0f4-a7d7e3edc824 tempest-VolumesActionsTest-518524336 None] Attaching volume 89512d91-5ab7-481c-8724-a841e5a39908 to instance 3d9e29cb-a5b5-48ee-bdc9-d4b50583ee0a at mountpoint /dev/vdb on host None. Apr 15 22:23:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5d7f06e0-e153-4288-b0f4-a7d7e3edc824 tempest-VolumesActionsTest-518524336 None] Attach volume completed successfully. Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5d7f06e0-e153-4288-b0f4-a7d7e3edc824 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908" released by "attach_volume" :: held 0.269s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:08 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" returned: 0 in 1.010s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Lock "cinder-quobyte-66db4bfa-2b7a-4220-8940-1680bd5d9ca5" released by "delete_volume" :: held 2.409s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Created reservations ['297d77f9-51a6-48d7-ac24-644c1f3e2b34', 'bafcb8e9-d09e-4b0b-beb2-7bae40e14e2c', 'e2ad11fb-40a1-44fe-8acc-274d9ffffc03', 'edc30697-0780-482c-ab88-d6bae3871164'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:08 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:08 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e403fbb-b006-48b5-aa1a-cb1d9e6734c0 tempest-VolumesActionsTest-518524336 None] Acquiring lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-detach_volume" by "detach_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e403fbb-b006-48b5-aa1a-cb1d9e6734c0 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9e403fbb-b006-48b5-aa1a-cb1d9e6734c0 tempest-VolumesActionsTest-518524336 None] Detaching volume 89512d91-5ab7-481c-8724-a841e5a39908 from instance 3d9e29cb-a5b5-48ee-bdc9-d4b50583ee0a. Apr 15 22:23:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9e403fbb-b006-48b5-aa1a-cb1d9e6734c0 tempest-VolumesActionsTest-518524336 None] Detach volume completed successfully. Apr 15 22:23:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e403fbb-b006-48b5-aa1a-cb1d9e6734c0 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:09 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 1.063s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:09 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Deleted volume successfully. Apr 15 22:23:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9f83dc18-6e91-4632-a601-432fdf9492e0 tempest-VolumesActionsTest-635647250 None] Lock "cinder-66db4bfa-2b7a-4220-8940-1680bd5d9ca5-delete_volume" released by "delete_volume" :: held 3.864s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Flow 'volume_create_manager' (127ec2ba-31ff-4828-b82f-bff0987eed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6503b1a-c96b-4be4-be4c-fd54a6382db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6503b1a-c96b-4be4-be4c-fd54a6382db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1203642479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aee576b-063e-474c-9e5a-cdacdca8c09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09fa85c3dc14b56be25bfe2a2531c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:14Z,use_quota=True,user_id='767166c69e224b08ae7b19164a85ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ead517-1cc6-4b4f-b171-73b0ea9b199e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ead517-1cc6-4b4f-b171-73b0ea9b199e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaa237f-e789-467d-a0df-b824941da31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aaa237f-e789-467d-a0df-b824941da31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aee576b-063e-474c-9e5a-cdacdca8c09f', 'volume_name': 'volume-5aee576b-063e-474c-9e5a-cdacdca8c09f', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f596ac-337e-432c-b158-ad9f104ad13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f596ac-337e-432c-b158-ad9f104ad13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295f2886-8d95-458b-b3da-2835eac634a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:13 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Volume 5aee576b-063e-474c-9e5a-cdacdca8c09f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aee576b-063e-474c-9e5a-cdacdca8c09f', 'volume_size': 1} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1203642479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aee576b-063e-474c-9e5a-cdacdca8c09f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09fa85c3dc14b56be25bfe2a2531c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:14Z,use_quota=True,user_id='767166c69e224b08ae7b19164a85ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Creating volume 5aee576b-063e-474c-9e5a-cdacdca8c09f {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:13 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:13 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f 1073741824 Apr 15 22:23:13 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:14 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f 1073741824" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:14 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f Apr 15 22:23:14 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:14 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295f2886-8d95-458b-b3da-2835eac634a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aee576b-063e-474c-9e5a-cdacdca8c09f', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3acf51-da13-4a95-9d74-241686a2e776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:14 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Volume volume-5aee576b-063e-474c-9e5a-cdacdca8c09f (5aee576b-063e-474c-9e5a-cdacdca8c09f): created successfully Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3acf51-da13-4a95-9d74-241686a2e776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Flow 'volume_create_manager' (127ec2ba-31ff-4828-b82f-bff0987eed05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:15 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6b60966b-0a55-4e5b-bbef-2671aea15c17 tempest-VolumesListAdminTestJSON-2038312205 None] Created volume successfully. Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Flow 'volume_create_manager' (3cbbf567-c7e4-4d8a-b9b1-70f89962d19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d18767-d2a2-43b8-a8c4-5c61bab155ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d18767-d2a2-43b8-a8c4-5c61bab155ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1051932240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0610431-28fb-46a8-b7ae-0c45866c0bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09fa85c3dc14b56be25bfe2a2531c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:16Z,use_quota=True,user_id='767166c69e224b08ae7b19164a85ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da08f75-6580-4a1a-8d5d-43d4b499745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3da08f75-6580-4a1a-8d5d-43d4b499745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403e4250-29b7-4820-b31e-05b0eeb5f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403e4250-29b7-4820-b31e-05b0eeb5f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0610431-28fb-46a8-b7ae-0c45866c0bde', 'volume_name': 'volume-f0610431-28fb-46a8-b7ae-0c45866c0bde', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffff3ede-9e5f-47a1-81de-0e12973f895a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffff3ede-9e5f-47a1-81de-0e12973f895a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f75240-dbc6-4317-aef6-830a67170929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Volume f0610431-28fb-46a8-b7ae-0c45866c0bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0610431-28fb-46a8-b7ae-0c45866c0bde', 'volume_size': 1} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1051932240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0610431-28fb-46a8-b7ae-0c45866c0bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09fa85c3dc14b56be25bfe2a2531c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:16Z,use_quota=True,user_id='767166c69e224b08ae7b19164a85ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Creating volume f0610431-28fb-46a8-b7ae-0c45866c0bde {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:16 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:16 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde 1073741824 Apr 15 22:23:16 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (f4175c58-5aad-4519-917c-d27614cfd5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193b34f4-ad07-4a6c-ab52-396a79c7c4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193b34f4-ad07-4a6c-ab52-396a79c7c4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064471792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93ca24b-ffcd-4662-86d7-cb53c7faa51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:16Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e26a82a-e570-48b9-8cda-d96132f9e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e26a82a-e570-48b9-8cda-d96132f9e57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629315ff-7e86-4c71-842c-24c6b80a2706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629315ff-7e86-4c71-842c-24c6b80a2706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93ca24b-ffcd-4662-86d7-cb53c7faa51e', 'volume_name': 'volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d71a1c-b767-4e6d-bc70-615d0c64af72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d71a1c-b767-4e6d-bc70-615d0c64af72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc092f83-c9a5-456f-8425-b0ee4dbef4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:16 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Volume a93ca24b-ffcd-4662-86d7-cb53c7faa51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e', 'volume_size': 1} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:16 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde 1073741824" returned: 0 in 0.509s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:16 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde Apr 15 22:23:16 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:17 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde" returned: 0 in 0.442s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:17 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:17 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.890s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1064471792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93ca24b-ffcd-4662-86d7-cb53c7faa51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:16Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Creating volume a93ca24b-ffcd-4662-86d7-cb53c7faa51e {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:17 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f75240-dbc6-4317-aef6-830a67170929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0610431-28fb-46a8-b7ae-0c45866c0bde', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f0885f-ddb1-465e-a971-923fe92826af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:17 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Volume volume-f0610431-28fb-46a8-b7ae-0c45866c0bde (f0610431-28fb-46a8-b7ae-0c45866c0bde): created successfully Apr 15 22:23:17 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e 1073741824 Apr 15 22:23:17 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f0885f-ddb1-465e-a971-923fe92826af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Flow 'volume_create_manager' (3cbbf567-c7e4-4d8a-b9b1-70f89962d19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:17 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f0a8df13-5033-44e8-881f-c88d0b720c51 tempest-VolumesListAdminTestJSON-2038312205 None] Created volume successfully. Apr 15 22:23:17 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.453s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:17 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e 1073741824" returned: 0 in 0.544s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:17 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e Apr 15 22:23:17 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:18 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc092f83-c9a5-456f-8425-b0ee4dbef4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeba77f5-2954-4586-9ab2-bc037f62127e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:18 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Volume volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e (a93ca24b-ffcd-4662-86d7-cb53c7faa51e): created successfully Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeba77f5-2954-4586-9ab2-bc037f62127e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (f4175c58-5aad-4519-917c-d27614cfd5c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-33d4a416-1605-4d5f-9549-ff31261996de tempest-VolumesActionsTest-635647250 None] Created volume successfully. Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Flow 'volume_create_manager' (73245588-4c13-4aaa-af2c-3f990ed76a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43eec723-10f3-4be9-a75e-50aceea2701b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43eec723-10f3-4be9-a75e-50aceea2701b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2095888767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b407d2-0520-4fb8-878e-a8d8812d7c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09fa85c3dc14b56be25bfe2a2531c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:19Z,use_quota=True,user_id='767166c69e224b08ae7b19164a85ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b6ba7-5d5b-4ea7-8d58-7504f8c422e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe0b6ba7-5d5b-4ea7-8d58-7504f8c422e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e4a764-e0b6-401a-bea1-c1a6a8bda70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e4a764-e0b6-401a-bea1-c1a6a8bda70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b407d2-0520-4fb8-878e-a8d8812d7c68', 'volume_name': 'volume-12b407d2-0520-4fb8-878e-a8d8812d7c68', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa26a3f-40cd-4a7a-9ea8-01b001c8125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa26a3f-40cd-4a7a-9ea8-01b001c8125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4373cf-34b0-4b9f-8209-56c20032f109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:18 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Volume 12b407d2-0520-4fb8-878e-a8d8812d7c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b407d2-0520-4fb8-878e-a8d8812d7c68', 'volume_size': 1} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2095888767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b407d2-0520-4fb8-878e-a8d8812d7c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f09fa85c3dc14b56be25bfe2a2531c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:19Z,use_quota=True,user_id='767166c69e224b08ae7b19164a85ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Creating volume 12b407d2-0520-4fb8-878e-a8d8812d7c68 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:18 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:18 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 1073741824 Apr 15 22:23:18 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:19 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 1073741824" returned: 0 in 0.775s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:19 devstack sudo[86046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 Apr 15 22:23:19 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-a93ca24b-ffcd-4662-86d7-cb53c7faa51e-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Lock "cinder-a93ca24b-ffcd-4662-86d7-cb53c7faa51e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-quobyte-a93ca24b-ffcd-4662-86d7-cb53c7faa51e" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-a93ca24b-ffcd-4662-86d7-cb53c7faa51e" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c7061-0cab-4f7d-b44d-087f1e7d5544]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:20 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e Apr 15 22:23:20 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:20 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68" returned: 0 in 0.625s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.763s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba4373cf-34b0-4b9f-8209-56c20032f109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b407d2-0520-4fb8-878e-a8d8812d7c68', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34230c3e-249e-40dc-907b-59bcfef82f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[621e5567-bb19-4d4b-af6f-6c0a3f19706c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:20 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Volume volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 (12b407d2-0520-4fb8-878e-a8d8812d7c68): created successfully Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34230c3e-249e-40dc-907b-59bcfef82f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Flow 'volume_create_manager' (73245588-4c13-4aaa-af2c-3f990ed76a7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:20 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ede3930f-2b9c-4a40-8cbc-aa2149902400 tempest-VolumesListAdminTestJSON-2038312205 None] Created volume successfully. Apr 15 22:23:20 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:20 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:20 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e" returned: 0 in 0.501s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:20 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e Apr 15 22:23:20 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:20 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.474s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b21c1b8-dc66-4321-97a2-cd4617034789]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:20 devstack sudo[86062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:20 devstack sudo[86062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:20 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a93ca24b-ffcd-4662-86d7-cb53c7faa51e" returned: 0 in 0.430s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-a93ca24b-ffcd-4662-86d7-cb53c7faa51e" released by "delete_volume" :: held 0.988s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:20 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Created reservations ['63e9be6e-f357-4b7f-b6dd-997ab35c02ad', '25e36e7e-f106-402a-83a0-efaeaf927d5d', '1fe8610c-b3a3-4289-96c1-3a4d8e1c4303', '98e5fa64-11b0-46c9-b430-2a2a27bb610b'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:21 devstack sudo[86065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:21 devstack sudo[86065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:21 devstack sudo[86062]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.744s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.e9b49a35-ab75-418d-8410-767ea74ef204nirkvobg.img {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:21 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.e9b49a35-ab75-418d-8410-767ea74ef204nirkvobg.img Apr 15 22:23:21 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Flow 'volume_create_manager' (0d304642-3e84-4a3e-a6ef-52da2cc2e2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544e139c-f634-48ff-a302-0d00cfddd169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (544e139c-f634-48ff-a302-0d00cfddd169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f8f848-61a2-4391-99ef-de5c2d6382d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f9afa38073495497e76e0459e3f9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:22Z,use_quota=True,user_id='a7ea98a324854a5291b08ef100a90a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3225e6e9-e56f-428c-a79a-227c3d9d6141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3225e6e9-e56f-428c-a79a-227c3d9d6141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b62565-b1f0-41d4-83bd-b97708f61a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b62565-b1f0-41d4-83bd-b97708f61a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84f8f848-61a2-4391-99ef-de5c2d6382d1', 'volume_name': 'volume-84f8f848-61a2-4391-99ef-de5c2d6382d1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9023d-2996-4b55-a7d5-823bb43c080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d9023d-2996-4b55-a7d5-823bb43c080e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642f1e5e-cfd4-423c-80f4-4b1752d0df7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Volume 84f8f848-61a2-4391-99ef-de5c2d6382d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84f8f848-61a2-4391-99ef-de5c2d6382d1', 'volume_size': 1} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (b64f7ad3-e65a-4a52-9cdb-466a0c7d3a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41496981-d672-491b-99ec-f8991933062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41496981-d672-491b-99ec-f8991933062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978633465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c89911-db4d-4fda-8667-de077560908a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:22Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14da9cf-e71d-44d4-b2e8-06bd2eaa794f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14da9cf-e71d-44d4-b2e8-06bd2eaa794f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77c541d-06a3-48bb-88df-25412cafd9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e77c541d-06a3-48bb-88df-25412cafd9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c89911-db4d-4fda-8667-de077560908a', 'volume_name': 'volume-07c89911-db4d-4fda-8667-de077560908a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226e7997-97e0-4f9b-9a2d-951202d55d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226e7997-97e0-4f9b-9a2d-951202d55d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815ce6ee-2a9d-481f-869f-8910272762ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:21 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Volume 07c89911-db4d-4fda-8667-de077560908a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c89911-db4d-4fda-8667-de077560908a', 'volume_size': 1} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:21 devstack sudo[86065]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.865s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:21 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Deleted volume successfully. Apr 15 22:23:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95305ad7-23ca-4452-98a3-fc2261b22312 tempest-VolumesActionsTest-761388560 None] Lock "cinder-a93ca24b-ffcd-4662-86d7-cb53c7faa51e-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:24 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.e9b49a35-ab75-418d-8410-767ea74ef204nirkvobg.img" returned: 0 in 2.919s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:24 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[553e7320-6596-4a08-9e50-f28c185f488e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:24 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:24 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:25 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.669s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:25 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908, size 1024.00 MB, duration 2.92 sec, destination /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.e9b49a35-ab75-418d-8410-767ea74ef204nirkvobg.img {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:23:25 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Converted 1024.00 MB image at 350.72 MB/s Apr 15 22:23:25 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] e9b49a35-ab75-418d-8410-767ea74ef204 was raw, no need to convert to raw {{(pid=81921) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 22:23:30 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-6d5630e0-e45b-4867-9786-9465bad4ff0f tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Terminate volume connection completed successfully. Apr 15 22:23:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-6d5630e0-e45b-4867-9786-9465bad4ff0f tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Deleting attachment 954b0979-f678-44b1-b04f-3190cbfbd221. {{(pid=81921) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "cinder-949f40b1-f80e-4a69-aa66-87d66d612ef4-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-949f40b1-f80e-4a69-aa66-87d66d612ef4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "cinder-quobyte-949f40b1-f80e-4a69-aa66-87d66d612ef4" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-quobyte-949f40b1-f80e-4a69-aa66-87d66d612ef4" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfaccab-1b70-4ad3-888d-ef3ec155d448]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:31 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:23:31 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:31 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 0 in 0.612s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:31 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:23:31 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:32 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 1 in 0.583s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:23:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:32 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4 Apr 15 22:23:32 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:32 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-949f40b1-f80e-4a69-aa66-87d66d612ef4" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-quobyte-949f40b1-f80e-4a69-aa66-87d66d612ef4" released by "delete_volume" :: held 1.738s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:32 devstack cinder-volume[81921]: DEBUG cinder.quota [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Created reservations ['4a75c313-c223-4836-9146-1ec963d93198', '3842e324-0a83-4b25-a676-a499cae140c6', '6a0acbc8-8da1-43ef-a200-5923d409a2a1', '38293864-2b72-4a7b-97f7-d43f49e411ab'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:33 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:33 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:33 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.519s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG cinder.manager [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Deleted volume successfully. Apr 15 22:23:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-6e969cac-a721-46f1-9cd9-5b49783f5cf3 req-80fed261-5d17-4294-b3da-a53553b99232 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-949f40b1-f80e-4a69-aa66-87d66d612ef4-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.586s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Uploaded volume to glance image-id: e9b49a35-ab75-418d-8410-767ea74ef204. {{(pid=81921) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.114s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84f8f848-61a2-4391-99ef-de5c2d6382d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f9afa38073495497e76e0459e3f9c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:22Z,use_quota=True,user_id='a7ea98a324854a5291b08ef100a90a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Creating volume 84f8f848-61a2-4391-99ef-de5c2d6382d1 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:35 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:35 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 1073741824 Apr 15 22:23:35 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=85,cinder:SELECT=52,cinder:DELETE=9,cinder:INSERT=16 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:23:35 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=108,cinder:UPDATE=72,cinder:INSERT=31,cinder:DELETE=4 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:23:35 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-171aae81-e6b7-439c-b3f8-68aab6ccc6ae tempest-VolumesActionsTest-518524336 None] Copy volume to image completed successfully. Apr 15 22:23:36 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 1073741824" returned: 0 in 0.527s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:36 devstack sudo[86217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 Apr 15 22:23:36 devstack sudo[86217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:36 devstack sudo[86217]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1" returned: 0 in 0.481s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.052s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978633465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c89911-db4d-4fda-8667-de077560908a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:22Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Creating volume 07c89911-db4d-4fda-8667-de077560908a {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:36 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (642f1e5e-cfd4-423c-80f4-4b1752d0df7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84f8f848-61a2-4391-99ef-de5c2d6382d1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ecd5f4-ca61-43c7-aeff-bcd4af0a2a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:36 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Volume volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 (84f8f848-61a2-4391-99ef-de5c2d6382d1): created successfully Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ecd5f4-ca61-43c7-aeff-bcd4af0a2a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:36 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a 1073741824 Apr 15 22:23:36 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Flow 'volume_create_manager' (0d304642-3e84-4a3e-a6ef-52da2cc2e2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:36 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b7846d5d-51fd-4d09-a8b3-7e5b931420cb tempest-VolumesListAdminTestJSON-2115169357 None] Created volume successfully. Apr 15 22:23:37 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a 1073741824" returned: 0 in 0.543s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:37 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a Apr 15 22:23:37 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Acquiring lock "cinder-84f8f848-61a2-4391-99ef-de5c2d6382d1-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Lock "cinder-84f8f848-61a2-4391-99ef-de5c2d6382d1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Acquiring lock "cinder-quobyte-84f8f848-61a2-4391-99ef-de5c2d6382d1" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Lock "cinder-quobyte-84f8f848-61a2-4391-99ef-de5c2d6382d1" acquired by "delete_volume" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b42735b-f67a-459c-ad62-cac1fd898a74]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:37 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "cinder-12b407d2-0520-4fb8-878e-a8d8812d7c68-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a" returned: 0 in 0.466s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.221s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815ce6ee-2a9d-481f-869f-8910272762ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c89911-db4d-4fda-8667-de077560908a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c5a401-a383-427e-9501-77956b0b2676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-12b407d2-0520-4fb8-878e-a8d8812d7c68-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[da11892b-e7ca-43ac-90a5-1ce8b0aeeab9]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:37 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 Apr 15 22:23:37 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:37 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Volume volume-07c89911-db4d-4fda-8667-de077560908a (07c89911-db4d-4fda-8667-de077560908a): created successfully Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c5a401-a383-427e-9501-77956b0b2676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (b64f7ad3-e65a-4a52-9cdb-466a0c7d3a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-95272a00-5c50-48ea-b149-ce74af615e59 tempest-VolumesActionsTest-635647250 None] Created volume successfully. Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "cinder-quobyte-12b407d2-0520-4fb8-878e-a8d8812d7c68" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:38 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:38 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-quobyte-12b407d2-0520-4fb8-878e-a8d8812d7c68" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[53affb2a-a403-444b-af2b-b699ba45f309]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:38 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 Apr 15 22:23:38 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:38 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.492s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e4f217-56c6-4b27-bdb6-12c9f062dc9a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:38 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1" returned: 0 in 0.603s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:38 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1 Apr 15 22:23:38 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:38 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:38 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:38 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68" returned: 0 in 0.537s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:38 devstack sudo[86251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68 Apr 15 22:23:38 devstack sudo[86251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:38 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-84f8f848-61a2-4391-99ef-de5c2d6382d1" returned: 0 in 0.448s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Lock "cinder-quobyte-84f8f848-61a2-4391-99ef-de5c2d6382d1" released by "delete_volume" :: held 1.090s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Created reservations ['b29f4b01-cd24-4e20-b111-f5ea239f7743', '56f185c2-e9b7-4863-9fcf-d2844b623f02', 'c9b28930-1c6a-4fb8-afc2-1edde52a0549', '9c71634f-dcaf-479a-a89d-eeb5005c88fd'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-07c89911-db4d-4fda-8667-de077560908a-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Lock "cinder-07c89911-db4d-4fda-8667-de077560908a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-quobyte-07c89911-db4d-4fda-8667-de077560908a" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:39 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-07c89911-db4d-4fda-8667-de077560908a" acquired by "delete_volume" :: waited 0.043s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:39 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.626s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:39 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc413c-250d-4be6-910c-c557ac32ad7d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:39 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img Apr 15 22:23:39 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:39 devstack sudo[86251]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12b407d2-0520-4fb8-878e-a8d8812d7c68" returned: 0 in 0.538s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-quobyte-12b407d2-0520-4fb8-878e-a8d8812d7c68" released by "delete_volume" :: held 1.106s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Created reservations ['35c77867-da5c-4a70-817c-3342ab3753ed', 'fc852a0f-4136-43de-9411-04560ee9512a', '524da5a2-a021-43da-b106-e2fc0dea8920', '163a2a04-e2c2-4fed-bd09-650fb423666e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:39 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a Apr 15 22:23:39 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:39 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:39 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:39 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.419s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Deleted volume successfully. Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5fd1a51d-087a-4d88-97a9-0a1d27baef99 tempest-VolumesListAdminTestJSON-2115169357 None] Lock "cinder-84f8f848-61a2-4391-99ef-de5c2d6382d1-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:39 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a" returned: 0 in 0.882s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:40 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a Apr 15 22:23:40 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:40 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.958s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Deleted volume successfully. Apr 15 22:23:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a9baa1-c50c-4f9c-8f02-9bd70336c2bd tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-12b407d2-0520-4fb8-878e-a8d8812d7c68-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "cinder-f0610431-28fb-46a8-b7ae-0c45866c0bde-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-f0610431-28fb-46a8-b7ae-0c45866c0bde-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "cinder-quobyte-f0610431-28fb-46a8-b7ae-0c45866c0bde" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-quobyte-f0610431-28fb-46a8-b7ae-0c45866c0bde" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c94e6-0f6f-402c-9833-2c23f593b242]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:41 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-07c89911-db4d-4fda-8667-de077560908a" returned: 0 in 1.427s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-07c89911-db4d-4fda-8667-de077560908a" released by "delete_volume" :: held 2.347s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Created reservations ['551169a7-d366-43d2-9cb3-f3ca2a3fc23f', '69ec84fd-e8f1-4d97-9ad3-7dd604af7e8a', 'd837930f-9435-4d9f-8b57-dcc84cebcf9c', '0fd378f9-478b-472e-8005-200afe3cc549'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:41 devstack sudo[86287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde Apr 15 22:23:41 devstack sudo[86287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:41 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:41 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:41 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img" returned: 0 in 2.493s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd35d4c1-7986-4073-acbc-bd4f770d89f2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:41 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:41 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:41 devstack sudo[86287]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde" returned: 0 in 0.698s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:41 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.429s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:41 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Deleted volume successfully. Apr 15 22:23:41 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde Apr 15 22:23:41 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2a2731a2-cb57-4413-a8d2-e9f3a6ff3a6f tempest-VolumesActionsTest-761388560 None] Lock "cinder-07c89911-db4d-4fda-8667-de077560908a-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:42 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.595s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:23:42 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Converted 1024.00 MB image at 410.47 MB/s Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] 8be95783-2a74-4b69-83b8-624f44f7fc86 was raw, converting to qcow2 {{(pid=81921) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0850c474-4ce6-4ed7-bea5-7779b0bb0592]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:42 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img Apr 15 22:23:42 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:42 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f0610431-28fb-46a8-b7ae-0c45866c0bde" returned: 0 in 0.470s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-quobyte-f0610431-28fb-46a8-b7ae-0c45866c0bde" released by "delete_volume" :: held 1.238s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Created reservations ['24e053bb-0ccf-4e8b-a5fb-c4eefe193fb3', '42a68fbe-e36e-4f7a-956a-391a1eb9ff18', '0d16ee37-5555-410c-8a54-ad6e032aeeff', '385fff3d-66ec-412b-a683-d6ab5fd85a1e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:42 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:42 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (51aff246-b17b-4fed-aae3-3b42db59df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e18971-8fdb-44b6-99fe-59d5aadf974f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e18971-8fdb-44b6-99fe-59d5aadf974f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196971815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40953345-2229-46b3-bd73-91b19dec2300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:43Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc5cd49-ce98-46b0-8a34-078065ab89da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc5cd49-ce98-46b0-8a34-078065ab89da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ba3d19-7b22-44a7-a4de-74fea4d70c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ba3d19-7b22-44a7-a4de-74fea4d70c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40953345-2229-46b3-bd73-91b19dec2300', 'volume_name': 'volume-40953345-2229-46b3-bd73-91b19dec2300', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e3f1ce-a683-4298-9134-5b61862fae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e3f1ce-a683-4298-9134-5b61862fae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec853725-f454-48be-850b-bf49f9595c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:42 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Volume 40953345-2229-46b3-bd73-91b19dec2300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40953345-2229-46b3-bd73-91b19dec2300', 'volume_size': 1} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:42 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img" returned: 0 in 0.718s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:43 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img Apr 15 22:23:43 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:43 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.623s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:43 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Deleted volume successfully. Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-078e7db9-ddd3-472f-ada5-5c031f1471b8 tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-f0610431-28fb-46a8-b7ae-0c45866c0bde-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:43 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img" returned: 1 in 0.500s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img /opt/stack/data/cinder/conversion/vol_upload_tx0alp5u {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:43 devstack sudo[86340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img /opt/stack/data/cinder/conversion/vol_upload_tx0alp5u Apr 15 22:23:43 devstack sudo[86340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "cinder-5aee576b-063e-474c-9e5a-cdacdca8c09f-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-5aee576b-063e-474c-9e5a-cdacdca8c09f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "cinder-quobyte-5aee576b-063e-474c-9e5a-cdacdca8c09f" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-quobyte-5aee576b-063e-474c-9e5a-cdacdca8c09f" acquired by "delete_volume" :: waited 0.021s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa12f5-e0a0-4ead-a703-84bddb16669c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:43 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f Apr 15 22:23:43 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:43 devstack sudo[86340]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img /opt/stack/data/cinder/conversion/vol_upload_tx0alp5u" returned: 0 in 0.497s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Image conversion details: src /opt/stack/data/cinder/conversion/89512d91-5ab7-481c-8724-a841e5a39908.temp_image.8be95783-2a74-4b69-83b8-624f44f7fc86uzabdkjw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tx0alp5u {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:23:43 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6440dda-ebf9-4d93-bb06-e5226f2567a4]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tx0alp5u {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:44 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tx0alp5u Apr 15 22:23:44 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:44 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f" returned: 0 in 0.543s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:44 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f Apr 15 22:23:44 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:44 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tx0alp5u" returned: 0 in 0.508s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:44 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5aee576b-063e-474c-9e5a-cdacdca8c09f" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-quobyte-5aee576b-063e-474c-9e5a-cdacdca8c09f" released by "delete_volume" :: held 1.043s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Created reservations ['90d8f25f-0b20-4b97-847a-4698f105174c', '80a65855-5c89-4247-97ad-b26b680b827d', 'd730897c-4ff6-496d-a4ff-0d816ec48209', 'd93d60af-b351-4f1f-9308-db4989c0c3a7'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:44 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:44 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-197cd8ed-4572-4123-841e-7991bb586ca3 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Terminate volume connection completed successfully. Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-197cd8ed-4572-4123-841e-7991bb586ca3 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Deleting attachment f143554f-f5cf-4da9-974f-8d17e28115c3. {{(pid=81921) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 22:23:45 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.473s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Deleted volume successfully. Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fef588c9-25f7-4bb5-ac76-ec265465232a tempest-VolumesListAdminTestJSON-2038312205 None] Lock "cinder-5aee576b-063e-474c-9e5a-cdacdca8c09f-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.367s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Uploaded volume to glance image-id: 8be95783-2a74-4b69-83b8-624f44f7fc86. {{(pid=81921) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.473s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1196971815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40953345-2229-46b3-bd73-91b19dec2300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:43Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Creating volume 40953345-2229-46b3-bd73-91b19dec2300 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:45 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:45 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 1073741824 Apr 15 22:23:45 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9773dfd4-d53a-4136-aa5e-f18cca120e78 tempest-VolumesActionsTest-518524336 None] Copy volume to image completed successfully. Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "cinder-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "cinder-quobyte-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-quobyte-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3422fcb1-ff88-477f-84fd-e14e5a7ec6d3]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:45 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 Apr 15 22:23:45 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:45 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 1073741824" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:45 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 Apr 15 22:23:45 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:46 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626" returned: 0 in 0.539s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:46 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626 Apr 15 22:23:46 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:46 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300" returned: 0 in 0.609s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec853725-f454-48be-850b-bf49f9595c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40953345-2229-46b3-bd73-91b19dec2300', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca7c14f-c6c2-4968-8d5a-7ace21f0d29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:46 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Volume volume-40953345-2229-46b3-bd73-91b19dec2300 (40953345-2229-46b3-bd73-91b19dec2300): created successfully Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca7c14f-c6c2-4968-8d5a-7ace21f0d29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (51aff246-b17b-4fed-aae3-3b42db59df64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:46 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-614e5a59-84d5-43d9-8294-556dd6ab2651 tempest-VolumesActionsTest-635647250 None] Created volume successfully. Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Acquiring lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Acquiring lock "cinder-quobyte-89512d91-5ab7-481c-8724-a841e5a39908" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Lock "cinder-quobyte-89512d91-5ab7-481c-8724-a841e5a39908" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16b834f-c3be-47ce-a1c0-d268b71abe8e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:46 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:46 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:46 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626" returned: 0 in 0.573s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-quobyte-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626" released by "delete_volume" :: held 1.138s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.quota [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Created reservations ['3e29059f-7428-43e9-879d-af9e2c9465e8', '29dedffd-6638-4119-b069-f1afa5459565', '4d331e63-432c-4e0f-9085-4d4d4448c8c5', 'd104b42c-1d05-44e5-95be-34e463e0e0da'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:46 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:46 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-40953345-2229-46b3-bd73-91b19dec2300-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Lock "cinder-40953345-2229-46b3-bd73-91b19dec2300-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-quobyte-40953345-2229-46b3-bd73-91b19dec2300" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-40953345-2229-46b3-bd73-91b19dec2300" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c06eec-32a6-461e-b9d0-2896756ad015]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:47 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 Apr 15 22:23:47 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:47 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.667s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:47 devstack sudo[86388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908 Apr 15 22:23:47 devstack sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:47 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.616s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG cinder.manager [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:47 devstack cinder-volume[81921]: INFO cinder.volume.manager [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Deleted volume successfully. Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [req-56ac9a76-0125-447f-a388-a3a0d7f94a6d req-aa4edb5e-2e20-47ef-b148-6641a123a408 tempest-ServerBootFromVolumeStableRescueTest-1721697438 None] Lock "cinder-f8a48df8-b132-4ec7-9ffc-7f90ffe7d626-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:47 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300" returned: 0 in 0.678s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:47 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300 Apr 15 22:23:47 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:47 devstack sudo[86388]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-89512d91-5ab7-481c-8724-a841e5a39908" returned: 0 in 0.619s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Lock "cinder-quobyte-89512d91-5ab7-481c-8724-a841e5a39908" released by "delete_volume" :: held 1.307s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Created reservations ['03cd1ede-72df-4e1b-b486-c182ae1eb0d8', '89df57ae-6aa3-4107-8169-31963fa9dbd4', 'f9a665c5-cb43-4249-82fe-681c919c0d4d', '1d155c72-5de3-41f6-a850-2b93cd7d6dc6'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:48 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:48 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:48 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-40953345-2229-46b3-bd73-91b19dec2300" returned: 0 in 0.493s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-40953345-2229-46b3-bd73-91b19dec2300" released by "delete_volume" :: held 1.212s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Created reservations ['8f13f11a-c8d2-46b3-a1cb-acc4ad7a7832', '160937ac-a1d4-4795-8c5a-2e1b4f214a5c', '46aff74e-63c8-448a-a7f0-9b5da194081b', 'a50f1a80-1501-420f-acd6-adf310235a20'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:48 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:48 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:48 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.467s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:48 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Deleted volume successfully. Apr 15 22:23:48 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c0f869b2-530c-4b58-8c52-0ba2f02572a0 tempest-VolumesActionsTest-518524336 None] Lock "cinder-89512d91-5ab7-481c-8724-a841e5a39908-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:49 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.548s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:49 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Deleted volume successfully. Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-001d26fc-dedd-4e90-822c-2b48bdca3fc7 tempest-VolumesActionsTest-761388560 None] Lock "cinder-40953345-2229-46b3-bd73-91b19dec2300-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (66a60439-a457-4a0b-93c9-8ed96a6934df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bd12e4-56b0-49a4-8c11-05e0c4a7d31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bd12e4-56b0-49a4-8c11-05e0c4a7d31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1753751662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b222f089-0ad6-408f-a43c-f3fca24762e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:50Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33f3253-cab1-4a6d-995e-a7be98dd958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33f3253-cab1-4a6d-995e-a7be98dd958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891f9cdc-073e-4ac7-9b13-6a5034f104b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (891f9cdc-073e-4ac7-9b13-6a5034f104b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b222f089-0ad6-408f-a43c-f3fca24762e1', 'volume_name': 'volume-b222f089-0ad6-408f-a43c-f3fca24762e1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07da5844-60ab-4b51-b6f2-89f886401eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07da5844-60ab-4b51-b6f2-89f886401eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e457302b-d563-466e-8c53-382cec153b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:49 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Volume b222f089-0ad6-408f-a43c-f3fca24762e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b222f089-0ad6-408f-a43c-f3fca24762e1', 'volume_size': 1} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1753751662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b222f089-0ad6-408f-a43c-f3fca24762e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:50Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Creating volume b222f089-0ad6-408f-a43c-f3fca24762e1 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:49 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:49 devstack sudo[86405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 1073741824 Apr 15 22:23:49 devstack sudo[86405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:50 devstack sudo[86405]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 1073741824" returned: 0 in 0.593s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Flow 'volume_create_manager' (d9200765-7244-4889-9a47-11bdf367749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e07ca0-c86b-4a93-9759-f5265569fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e07ca0-c86b-4a93-9759-f5265569fc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2017641236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820e9ff7-f36d-4381-b72e-3c4e3126ec7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f594a4b41e84332850d279ee004e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:50Z,use_quota=True,user_id='9f42975e25914f5fa551adf35fc2aa9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2772cdf-ca69-4367-98d6-fe7b4309e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2772cdf-ca69-4367-98d6-fe7b4309e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1edde2d-925b-493d-86b6-4213a40f9ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1edde2d-925b-493d-86b6-4213a40f9ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820e9ff7-f36d-4381-b72e-3c4e3126ec7e', 'volume_name': 'volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1381c7eb-d4ba-4b09-92ad-313e16ba8c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1381c7eb-d4ba-4b09-92ad-313e16ba8c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99fd165-8ec4-4f3b-92ce-f520cbec323d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:50 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Volume 820e9ff7-f36d-4381-b72e-3c4e3126ec7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e', 'volume_size': 1} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:50 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 Apr 15 22:23:50 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:50 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1" returned: 0 in 0.513s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2017641236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820e9ff7-f36d-4381-b72e-3c4e3126ec7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f594a4b41e84332850d279ee004e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:50Z,use_quota=True,user_id='9f42975e25914f5fa551adf35fc2aa9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Creating volume 820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:50 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e457302b-d563-466e-8c53-382cec153b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b222f089-0ad6-408f-a43c-f3fca24762e1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:50 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e 1073741824 Apr 15 22:23:50 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4c7f0b-3add-4cf4-acc7-8113fc3c9d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:50 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Volume volume-b222f089-0ad6-408f-a43c-f3fca24762e1 (b222f089-0ad6-408f-a43c-f3fca24762e1): created successfully Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef4c7f0b-3add-4cf4-acc7-8113fc3c9d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (66a60439-a457-4a0b-93c9-8ed96a6934df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:50 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-25019b1a-c477-4287-87b8-b1a39e2a8808 tempest-VolumesActionsTest-635647250 None] Created volume successfully. Apr 15 22:23:51 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e 1073741824" returned: 0 in 0.571s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:51 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e Apr 15 22:23:51 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-b222f089-0ad6-408f-a43c-f3fca24762e1-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Lock "cinder-b222f089-0ad6-408f-a43c-f3fca24762e1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Acquiring lock "cinder-quobyte-b222f089-0ad6-408f-a43c-f3fca24762e1" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-b222f089-0ad6-408f-a43c-f3fca24762e1" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a1dffe-54f7-47e2-899d-051455b861c3]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:52 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 Apr 15 22:23:52 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:52 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" returned: 0 in 0.660s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e99fd165-8ec4-4f3b-92ce-f520cbec323d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1869bd4-f0c6-4478-802c-a3c14cf8f2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:52 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Volume volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e (820e9ff7-f36d-4381-b72e-3c4e3126ec7e): created successfully Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1869bd4-f0c6-4478-802c-a3c14cf8f2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Flow 'volume_create_manager' (d9200765-7244-4889-9a47-11bdf367749c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:52 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f18be30e-0476-4ff4-886f-2e65ea0847f7 tempest-VolumesDeleteCascade-266917969 None] Created volume successfully. Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Creating offline snapshot 96ab6768-9f0d-49c6-bb7a-1c78055747ea of volume 820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[45351004-ac08-48eb-9875-38713be5e3c0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:52 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e Apr 15 22:23:52 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:52 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1" returned: 0 in 0.678s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:52 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1 Apr 15 22:23:52 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:53 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" returned: 0 in 0.589s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:53 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea 1G Apr 15 22:23:53 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:53 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b222f089-0ad6-408f-a43c-f3fca24762e1" returned: 0 in 0.552s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Lock "cinder-quobyte-b222f089-0ad6-408f-a43c-f3fca24762e1" released by "delete_volume" :: held 1.291s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Created reservations ['722842d8-af3a-4d9c-a8f3-d18e49596359', '19bb6200-107d-484e-894e-53076ea6c95f', '4596210a-4c7a-40cb-9816-9a5f08d75d8a', 'b2a2f2d8-5747-4a90-b260-ceba480c1179'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:53 devstack sudo[86471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:53 devstack sudo[86471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:53 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea 1G" returned: 0 in 0.557s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:53 devstack sudo[86476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea Apr 15 22:23:53 devstack sudo[86476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:53 devstack sudo[86471]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.497s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:23:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Deleted volume successfully. Apr 15 22:23:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-496c6c0d-c740-4af4-8c8e-e5798043c02e tempest-VolumesActionsTest-761388560 None] Lock "cinder-b222f089-0ad6-408f-a43c-f3fca24762e1-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:54 devstack sudo[86476]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea" returned: 0 in 0.524s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:54 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea is being set with open permissions: ugo+rw Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:54 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea Apr 15 22:23:54 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (e745313b-35b8-46da-9080-6cc9b53430fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfcb727-10ff-45f7-85af-61139e7d1a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfcb727-10ff-45f7-85af-61139e7d1a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73936164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a75620-d8be-4cd4-8862-9bde6a5ced13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:54Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded411b7-ac11-446b-9d61-c55001deceb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ded411b7-ac11-446b-9d61-c55001deceb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738b49b0-8e84-44b9-9c50-6e8aa9907e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738b49b0-8e84-44b9-9c50-6e8aa9907e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a75620-d8be-4cd4-8862-9bde6a5ced13', 'volume_name': 'volume-27a75620-d8be-4cd4-8862-9bde6a5ced13', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3eb0c6-e12d-4f5d-a2be-737fe73f57f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3eb0c6-e12d-4f5d-a2be-737fe73f57f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe6def4-2414-4489-a676-ddcbe1682702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:54 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Volume 27a75620-d8be-4cd4-8862-9bde6a5ced13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a75620-d8be-4cd4-8862-9bde6a5ced13', 'volume_size': 1} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:54 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea" returned: 0 in 0.511s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:54 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.info Apr 15 22:23:54 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:55 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.info" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:55 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.info is being set with open permissions: ugo+rw Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:55 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.info Apr 15 22:23:55 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:55 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.info" returned: 0 in 0.531s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.244s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.257s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-73936164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a75620-d8be-4cd4-8862-9bde6a5ced13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abadcb29e9034909927f1860b604a8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:23:54Z,use_quota=True,user_id='a438d9d9af5549d8baadbdd90cb33ffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Creating volume 27a75620-d8be-4cd4-8862-9bde6a5ced13 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:23:55 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:23:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:55 devstack sudo[86491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 1073741824 Apr 15 22:23:55 devstack sudo[86491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-408ca58a-7aa3-4be6-a1cf-ca31da7fdfdb tempest-VolumesDeleteCascade-266917969 None] Create snapshot completed successfully Apr 15 22:23:56 devstack sudo[86491]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 1073741824" returned: 0 in 0.564s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:56 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 Apr 15 22:23:56 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:56 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13" returned: 0 in 0.491s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.031s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Creating offline snapshot cd89da74-c321-4741-b198-68d8a89846a9 of volume 820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe6def4-2414-4489-a676-ddcbe1682702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a75620-d8be-4cd4-8862-9bde6a5ced13', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49b8196-b240-4680-ae06-8b5db8c749f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:23:57 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdb2d19-c074-4fe2-bd4d-ab79cc0c515c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:57 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Volume volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 (27a75620-d8be-4cd4-8862-9bde6a5ced13): created successfully Apr 15 22:23:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49b8196-b240-4680-ae06-8b5db8c749f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:23:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Flow 'volume_create_manager' (e745313b-35b8-46da-9080-6cc9b53430fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:23:57 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-aea156d7-ca3f-4bf0-8718-312b8a4cafea tempest-VolumesActionsTest-635647250 None] Created volume successfully. Apr 15 22:23:57 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea Apr 15 22:23:57 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:57 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea" returned: 0 in 0.656s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:23:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:57 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 1G Apr 15 22:23:57 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Acquiring lock "cinder-27a75620-d8be-4cd4-8862-9bde6a5ced13-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Lock "cinder-27a75620-d8be-4cd4-8862-9bde6a5ced13-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:58 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 1G" returned: 0 in 0.743s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:58 devstack sudo[86510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 Apr 15 22:23:58 devstack sudo[86510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Acquiring lock "cinder-quobyte-27a75620-d8be-4cd4-8862-9bde6a5ced13" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Lock "cinder-quobyte-27a75620-d8be-4cd4-8862-9bde6a5ced13" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c9d0f-6648-47e5-85ad-05df938b80f6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:58 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 Apr 15 22:23:58 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:58 devstack sudo[86510]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9" returned: 0 in 0.501s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:58 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 is being set with open permissions: ugo+rw Apr 15 22:23:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:58 devstack sudo[86518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 Apr 15 22:23:58 devstack sudo[86518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:59 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13" returned: 0 in 0.731s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:59 devstack sudo[86523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13 Apr 15 22:23:59 devstack sudo[86523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:23:59 devstack sudo[86518]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9" returned: 0 in 0.509s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e78bde77-b825-4eee-9f63-fb30a660a1fb tempest-VolumesDeleteCascade-266917969 None] Create snapshot completed successfully Apr 15 22:23:59 devstack sudo[86523]: pam_unix(sudo:session): session closed for user root Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-27a75620-d8be-4cd4-8862-9bde6a5ced13" returned: 0 in 0.557s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Lock "cinder-quobyte-27a75620-d8be-4cd4-8862-9bde6a5ced13" released by "delete_volume" :: held 1.315s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Created reservations ['7bc57c2f-131a-42cc-9727-2d0b85275833', '5a360c23-d685-48a1-85af-1a0734395552', 'b0fc9064-2769-43ac-b4f8-b22e824a06da', '7dba06db-97ae-46ec-8d75-52f926d05389'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:23:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:23:59 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:23:59 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-820e9ff7-f36d-4381-b72e-3c4e3126ec7e-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-820e9ff7-f36d-4381-b72e-3c4e3126ec7e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Performing cascade delete. {{(pid=81921) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-96ab6768-9f0d-49c6-bb7a-1c78055747ea-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-96ab6768-9f0d-49c6-bb7a-1c78055747ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-96ab6768-9f0d-49c6-bb7a-1c78055747ea" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-96ab6768-9f0d-49c6-bb7a-1c78055747ea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Deleting offline snapshot 96ab6768-9f0d-49c6-bb7a-1c78055747ea of volume 820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] snapshot_file for this snap is: volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2456decb-a7c7-4c54-bdc5-e85c8d5b27f7]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:00 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea Apr 15 22:24:00 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:00 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.678s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Deleted volume successfully. Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90375c77-0852-4dbd-8385-383e3e4dabd4 tempest-VolumesActionsTest-635647250 None] Lock "cinder-27a75620-d8be-4cd4-8862-9bde6a5ced13-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:00 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea" returned: 0 in 0.688s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:01 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[552210c9-a0bc-41f8-9d79-206597b404bf]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:01 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e Apr 15 22:24:01 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:01 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" returned: 0 in 0.571s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:01 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a6d063-6310-4b29-92dd-80d5bbffc3c6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:01 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 Apr 15 22:24:01 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:02 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9" returned: 0 in 0.654s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[905bb737-fddc-43e3-bc7f-62bb421a0dd0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:02 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea Apr 15 22:24:02 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (84580d62-10cb-40d8-8658-3bd3d8dda1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe89feca-4036-4d2a-82b1-9eb34fffe252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe89feca-4036-4d2a-82b1-9eb34fffe252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473732967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccda5467-92f5-4c61-a33c-5185b7828244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:03Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32525122-0e46-4ac2-82e5-8b5dcf4c16c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32525122-0e46-4ac2-82e5-8b5dcf4c16c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430dc2e8-a483-459f-97ab-ca28aa80ace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430dc2e8-a483-459f-97ab-ca28aa80ace8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccda5467-92f5-4c61-a33c-5185b7828244', 'volume_name': 'volume-ccda5467-92f5-4c61-a33c-5185b7828244', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9e69e-89a3-4042-ba54-ecd81938ff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9e69e-89a3-4042-ba54-ecd81938ff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32014a12-7510-45b2-a7e9-3a623891d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:02 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume ccda5467-92f5-4c61-a33c-5185b7828244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccda5467-92f5-4c61-a33c-5185b7828244', 'volume_size': 1} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473732967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccda5467-92f5-4c61-a33c-5185b7828244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:03Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Creating volume ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:02 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:02 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 1073741824 Apr 15 22:24:02 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:02 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea" returned: 0 in 0.627s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[193a78f4-c0e5-41f8-84bf-39bfcd7fdab6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:03 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e Apr 15 22:24:03 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:03 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 1073741824" returned: 0 in 0.749s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:03 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 Apr 15 22:24:03 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:03 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" returned: 0 in 0.749s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:03 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea Apr 15 22:24:03 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:04 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244" returned: 0 in 0.548s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32014a12-7510-45b2-a7e9-3a623891d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccda5467-92f5-4c61-a33c-5185b7828244', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ca9deb-39e5-4a9d-a0f1-bed24d8d4411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:04 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume volume-ccda5467-92f5-4c61-a33c-5185b7828244 (ccda5467-92f5-4c61-a33c-5185b7828244): created successfully Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ca9deb-39e5-4a9d-a0f1-bed24d8d4411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (84580d62-10cb-40d8-8658-3bd3d8dda1d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f6af3a0b-d27a-4daf-a078-70f18b1fe1c1 tempest-VolumesSnapshotTestJSON-1378274503 None] Created volume successfully. Apr 15 22:24:04 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea" returned: 0 in 0.579s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:04 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea Apr 15 22:24:04 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:04 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.96ab6768-9f0d-49c6-bb7a-1c78055747ea" returned: 0 in 0.502s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 -F qcow2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:04 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 -F qcow2 Apr 15 22:24:04 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Creating offline snapshot 8901eecf-a787-46f2-8302-559105467968 of volume ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5922cf-d424-4d22-8e1d-766957ae39f9]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:05 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 Apr 15 22:24:05 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:05 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 -F qcow2" returned: 0 in 0.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-96ab6768-9f0d-49c6-bb7a-1c78055747ea" released by "_delete_snapshot" :: held 5.044s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" released by "delete_snapshot" :: held 5.067s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Created reservations ['52474699-92c7-4ed7-9d24-92fb961ca010', 'ccca0b89-5920-4cdd-b696-6241d7d515ce', '0aa2d2af-e80d-44d1-8a6b-e23d722576db', 'b7345c42-d3f8-4e93-9255-f2196defa831'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:05 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Delete snapshot completed successfully. Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-96ab6768-9f0d-49c6-bb7a-1c78055747ea-delete_snapshot" released by "delete_snapshot" :: held 5.209s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-cd89da74-c321-4741-b198-68d8a89846a9-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-cd89da74-c321-4741-b198-68d8a89846a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-cd89da74-c321-4741-b198-68d8a89846a9" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-cd89da74-c321-4741-b198-68d8a89846a9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Deleting offline snapshot cd89da74-c321-4741-b198-68d8a89846a9 of volume 820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] snapshot_file for this snap is: volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b9233d-21f0-4ecb-a363-1cbc1d753d26]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:05 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 Apr 15 22:24:05 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:05 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244" returned: 0 in 0.691s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:05 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 1G Apr 15 22:24:05 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:06 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9" returned: 0 in 0.721s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[634d6472-8e0f-4fb5-b048-ec63c2c98052]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:06 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e Apr 15 22:24:06 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:06 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 1G" returned: 0 in 0.618s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccda5467-92f5-4c61-a33c-5185b7828244 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:06 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccda5467-92f5-4c61-a33c-5185b7828244 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 Apr 15 22:24:06 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:06 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" returned: 0 in 0.599s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:06 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 Apr 15 22:24:06 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:07 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccda5467-92f5-4c61-a33c-5185b7828244 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968" returned: 0 in 0.578s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:07 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 is being set with open permissions: ugo+rw Apr 15 22:24:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:07 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 Apr 15 22:24:07 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:07 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968" returned: 0 in 0.470s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:07 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9" returned: 0 in 0.690s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:07 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.info Apr 15 22:24:07 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:07 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9 Apr 15 22:24:07 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:08 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.info" returned: 0 in 0.747s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:08 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.info is being set with open permissions: ugo+rw Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:08 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.info Apr 15 22:24:08 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:08 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e.cd89da74-c321-4741-b198-68d8a89846a9" returned: 0 in 0.869s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-cd89da74-c321-4741-b198-68d8a89846a9" released by "_delete_snapshot" :: held 2.964s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" released by "delete_snapshot" :: held 2.976s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Created reservations ['4c7a4dab-a2d8-4d49-9687-88b349a10e58', 'ddf02b0b-a985-45ed-82b5-df17bd4c961c', '7af21bc7-20a1-4ff2-9cd8-75730a169c9b', '9aa85ee4-92bd-418f-8f85-5a2d9f9a0578'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Delete snapshot completed successfully. Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-cd89da74-c321-4741-b198-68d8a89846a9-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Snapshots deleted, issuing volume delete {{(pid=81921) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" acquired by "delete_volume" :: waited 0.019s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad171be3-3c45-4a97-bc21-fdc70bc0817b]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:08 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e Apr 15 22:24:08 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:09 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.info" returned: 0 in 1.004s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.217s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-71002b94-6a96-4252-8df7-6572e3f89b63 tempest-VolumesSnapshotTestJSON-1378274503 None] Create snapshot completed successfully Apr 15 22:24:09 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" returned: 0 in 1.191s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:09 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e Apr 15 22:24:09 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-8901eecf-a787-46f2-8302-559105467968-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-8901eecf-a787-46f2-8302-559105467968-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:10 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-ccda5467-92f5-4c61-a33c-5185b7828244" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" returned: 0 in 0.650s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-820e9ff7-f36d-4381-b72e-3c4e3126ec7e" released by "delete_volume" :: held 1.914s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ccda5467-92f5-4c61-a33c-5185b7828244" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-8901eecf-a787-46f2-8302-559105467968" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-8901eecf-a787-46f2-8302-559105467968" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Deleting offline snapshot 8901eecf-a787-46f2-8302-559105467968 of volume ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] snapshot_file for this snap is: volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4235786-dc1c-4138-8aed-f45b73e80ef1]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Created reservations ['ba2baec9-241f-43e2-8457-2cee27dd7f5e', 'f350c1d6-044d-4347-88f9-db0774d97b42', 'bd770210-a763-49db-83c5-7ef255acd986', 'e5814033-f192-4c73-be2f-aa3a8008ea1d'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:10 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 Apr 15 22:24:10 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:10 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:10 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:11 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.504s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:11 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Deleted volume successfully. Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d637e08-21d6-4a84-8984-128d389894dd tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-820e9ff7-f36d-4381-b72e-3c4e3126ec7e-delete_volume" released by "delete_volume" :: held 11.001s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:11 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968" returned: 0 in 0.775s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccda5467-92f5-4c61-a33c-5185b7828244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79006b0-e8ea-41ed-b875-51149b4a691f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:11 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 Apr 15 22:24:11 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Flow 'volume_create_manager' (f5fe7ea0-e33f-463e-93b8-2c2e97d91a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a9a72b-9812-428a-8eb9-53bf965dffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a9a72b-9812-428a-8eb9-53bf965dffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-371891752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e948b2a-5f74-488d-9a68-cd689e44fb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f594a4b41e84332850d279ee004e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:12Z,use_quota=True,user_id='9f42975e25914f5fa551adf35fc2aa9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84012134-e24c-4451-af49-6caea7847cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84012134-e24c-4451-af49-6caea7847cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de5561c-555f-4a13-a4bc-9191f951c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de5561c-555f-4a13-a4bc-9191f951c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e948b2a-5f74-488d-9a68-cd689e44fb35', 'volume_name': 'volume-8e948b2a-5f74-488d-9a68-cd689e44fb35', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b50cb41-cbb6-4b90-91df-7f6148d513ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b50cb41-cbb6-4b90-91df-7f6148d513ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ff4070-54f5-45e8-a05d-7cbbd4ed8913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:11 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Volume 8e948b2a-5f74-488d-9a68-cd689e44fb35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e948b2a-5f74-488d-9a68-cd689e44fb35', 'volume_size': 1} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-371891752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e948b2a-5f74-488d-9a68-cd689e44fb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f594a4b41e84332850d279ee004e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:12Z,use_quota=True,user_id='9f42975e25914f5fa551adf35fc2aa9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Creating volume 8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:11 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:11 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 1073741824 Apr 15 22:24:11 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:12 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244" returned: 0 in 0.683s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:12 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 Apr 15 22:24:12 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:12 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 1073741824" returned: 0 in 0.651s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:12 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 Apr 15 22:24:12 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:12 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968" returned: 0 in 0.672s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:12 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968 Apr 15 22:24:12 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:12 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35" returned: 0 in 0.521s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ff4070-54f5-45e8-a05d-7cbbd4ed8913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e948b2a-5f74-488d-9a68-cd689e44fb35', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5af2d2-afaf-4380-bda9-0d596b95c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:12 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Volume volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 (8e948b2a-5f74-488d-9a68-cd689e44fb35): created successfully Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5af2d2-afaf-4380-bda9-0d596b95c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Flow 'volume_create_manager' (f5fe7ea0-e33f-463e-93b8-2c2e97d91a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:12 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5e363c43-e0cd-45de-8d04-1c53c0232cd1 tempest-VolumesDeleteCascade-266917969 None] Created volume successfully. Apr 15 22:24:13 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244.8901eecf-a787-46f2-8302-559105467968" returned: 0 in 0.476s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-8901eecf-a787-46f2-8302-559105467968" released by "_delete_snapshot" :: held 2.670s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ccda5467-92f5-4c61-a33c-5185b7828244" released by "delete_snapshot" :: held 2.688s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['07b21cdf-2161-42b9-9dbf-eeab402c7eeb', 'ee1fbb60-ba06-4802-8097-ae4527798b3e', 'cdf8668c-9fd0-4a37-83aa-128c90776434', '5ef7444e-682f-4890-86d7-a593f725a000'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:13 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Delete snapshot completed successfully. Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3a4f50db-bbb1-48c2-9183-ad2dfa795a4e tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-8901eecf-a787-46f2-8302-559105467968-delete_snapshot" released by "delete_snapshot" :: held 2.837s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Creating offline snapshot ddfdcae0-f1d1-4201-b169-874ba0953593 of volume 8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736aa3f-ef9e-4ba6-a456-85f756e0b292]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:13 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 Apr 15 22:24:13 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (30823e99-f33a-461c-a3fe-8cbc594894f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71f85f-b31c-499f-8335-0a1d762d4e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d71f85f-b31c-499f-8335-0a1d762d4e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1146290216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb786e38-2f9b-405b-867c-54aff48e3af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:14Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f262c631-eeb1-4902-81cd-dda4bca3c8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f262c631-eeb1-4902-81cd-dda4bca3c8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc396dc-6fd6-4ba6-83ce-6750d140eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc396dc-6fd6-4ba6-83ce-6750d140eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb786e38-2f9b-405b-867c-54aff48e3af5', 'volume_name': 'volume-bb786e38-2f9b-405b-867c-54aff48e3af5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f212bd66-8c94-4127-a0ff-8f99d9c6fd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f212bd66-8c94-4127-a0ff-8f99d9c6fd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5275a3-ed4a-4ec3-a114-c9f27946ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:13 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume bb786e38-2f9b-405b-867c-54aff48e3af5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb786e38-2f9b-405b-867c-54aff48e3af5', 'volume_size': 1} Apr 15 22:24:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Flow 'volume_create_manager' (31e49209-aa1b-4709-b90d-448795a62fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bc78c9-9678-491f-9441-0ccc04f81176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bc78c9-9678-491f-9441-0ccc04f81176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-746115992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bd641c-37ec-47da-a5c2-7bcd9b46e85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e64ab7392ac42019aca7d741ace06ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:14Z,use_quota=True,user_id='681485b145284b59b78539d38383639c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150967e7-7ca0-4cea-87fb-5e08dcc401f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150967e7-7ca0-4cea-87fb-5e08dcc401f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88370f73-3a1e-4eb5-bd40-2ba1476e59b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.image.glance [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Creating Keystone auth plugin from conf {{(pid=81921) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88370f73-3a1e-4eb5-bd40-2ba1476e59b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3bd641c-37ec-47da-a5c2-7bcd9b46e85d', 'volume_name': 'volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec2c130-0d77-47d1-8fd7-22577ff564e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec2c130-0d77-47d1-8fd7-22577ff564e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4e2bfd-1e4a-4143-96d3-22465619dc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:14 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Volume e3bd641c-37ec-47da-a5c2-7bcd9b46e85d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Trying to clone e3bd641c-37ec-47da-a5c2-7bcd9b46e85d from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]). {{(pid=81921) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 22:24:14 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35" returned: 0 in 0.623s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:14 devstack sudo[86711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 1G Apr 15 22:24:14 devstack sudo[86711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 22:24:14 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Image download 20.69 MB at 20.69 MB/s Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c239e333-eb8d-4a38-9804-831256164d93]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:14 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD Apr 15 22:24:14 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:14 devstack sudo[86711]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 1G" returned: 0 in 0.509s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:14 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 Apr 15 22:24:14 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:15 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD" returned: 0 in 0.467s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd is fetched for user 681485b145284b59b78539d38383639c. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c851bcc-9dad-4dac-83f2-e78efb2d8dd3]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:15 devstack sudo[86724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD Apr 15 22:24:15 devstack sudo[86724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:15 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:15 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 is being set with open permissions: ugo+rw Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:15 devstack sudo[86729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 Apr 15 22:24:15 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:15 devstack sudo[86724]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:15 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593" returned: 0 in 0.448s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:15 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.info Apr 15 22:24:15 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:16 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.info" returned: 0 in 0.464s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:16 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.info is being set with open permissions: ugo+rw Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:16 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.info Apr 15 22:24:16 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:16 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.info" returned: 0 in 0.512s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.123s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.904s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1146290216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb786e38-2f9b-405b-867c-54aff48e3af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:14Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Creating volume bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:16 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:16 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 1073741824 Apr 15 22:24:16 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f86f93bc-468c-41d0-83ab-1949d150db61 tempest-VolumesDeleteCascade-266917969 None] Create snapshot completed successfully Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:17 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:17 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:17 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 1073741824" returned: 0 in 0.518s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:17 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 Apr 15 22:24:17 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:17 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.461s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:17 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5" returned: 0 in 0.512s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.304s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-746115992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3bd641c-37ec-47da-a5c2-7bcd9b46e85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e64ab7392ac42019aca7d741ace06ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:14Z,use_quota=True,user_id='681485b145284b59b78539d38383639c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Creating volume e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:17 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:17 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d 1073741824 Apr 15 22:24:17 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5275a3-ed4a-4ec3-a114-c9f27946ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb786e38-2f9b-405b-867c-54aff48e3af5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dbcc2b-459c-4c0a-bcf1-a9130108950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:17 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume volume-bb786e38-2f9b-405b-867c-54aff48e3af5 (bb786e38-2f9b-405b-867c-54aff48e3af5): created successfully Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dbcc2b-459c-4c0a-bcf1-a9130108950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (30823e99-f33a-461c-a3fe-8cbc594894f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-de9e8dad-5ede-43b5-975c-99b4902b9420 tempest-VolumesSnapshotTestJSON-1378274503 None] Created volume successfully. Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Flow 'volume_create_manager' (b865227c-2e6b-4263-98aa-b24c9306a7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea03729-9435-421f-9d72-3ca2660d0e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea03729-9435-421f-9d72-3ca2660d0e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1591046534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477fc868-6501-471c-b31a-c2e0049fe01b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f594a4b41e84332850d279ee004e4e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ddfdcae0-f1d1-4201-b169-874ba0953593,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:18Z,use_quota=True,user_id='9f42975e25914f5fa551adf35fc2aa9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1acfffc-4e7d-44f7-973c-c0dc3e0561b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1acfffc-4e7d-44f7-973c-c0dc3e0561b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61252cca-0781-44e3-a5c9-1de8d73f85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61252cca-0781-44e3-a5c9-1de8d73f85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '477fc868-6501-471c-b31a-c2e0049fe01b', 'volume_name': 'volume-477fc868-6501-471c-b31a-c2e0049fe01b', 'volume_size': 1, 'snapshot_id': 'ddfdcae0-f1d1-4201-b169-874ba0953593'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df81c48-3920-455f-b68e-3574af33a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df81c48-3920-455f-b68e-3574af33a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af62364c-d933-4ccb-ae82-b40c5f511583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:18 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Volume 477fc868-6501-471c-b31a-c2e0049fe01b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-477fc868-6501-471c-b31a-c2e0049fe01b', 'volume_size': 1, 'snapshot_id': 'ddfdcae0-f1d1-4201-b169-874ba0953593'} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:18 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d 1073741824" returned: 0 in 0.576s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:18 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d Apr 15 22:24:18 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:18 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" returned: 0 in 0.450s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.777s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Creating offline snapshot ac166e2a-b2c1-49fd-94ba-d71251b1c98e of volume bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Attempting download of 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume e3bd641c-37ec-47da-a5c2-7bcd9b46e85d. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3092d1-a609-4944-be64-0127f7169296]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec438acb-203c-40a7-8ffe-e358ad69b3f7]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_lloej2uj {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:19 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 Apr 15 22:24:19 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:19 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_lloej2uj Apr 15 22:24:19 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:19 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5" returned: 0 in 0.500s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:19 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_lloej2uj" returned: 0 in 0.480s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_lloej2uj {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:19 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e 1G Apr 15 22:24:19 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:19 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_lloej2uj Apr 15 22:24:19 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:19 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_lloej2uj" returned: 1 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_lloej2uj' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fd441b-7406-4d04-86d4-1ffa25f1494f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:20 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e 1G" returned: 0 in 0.501s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb786e38-2f9b-405b-867c-54aff48e3af5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:20 devstack sudo[86799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb786e38-2f9b-405b-867c-54aff48e3af5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e Apr 15 22:24:20 devstack sudo[86799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:20 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD Apr 15 22:24:20 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:20 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd was qcow2, converting to raw {{(pid=81921) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:20 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d Apr 15 22:24:20 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:20 devstack sudo[86799]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb786e38-2f9b-405b-867c-54aff48e3af5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e" returned: 0 in 0.484s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:20 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e is being set with open permissions: ugo+rw Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:20 devstack sudo[86810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e Apr 15 22:24:20 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:20 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e" returned: 0 in 0.462s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:21 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.info Apr 15 22:24:21 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:21 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" returned: 0 in 0.906s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:21 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_toz6jk7ndevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:24:21 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Converted 112.00 MB image at 112.00 MB/s Apr 15 22:24:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:21 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d 1G Apr 15 22:24:21 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:21 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.info" returned: 0 in 0.641s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:21 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.info is being set with open permissions: ugo+rw Apr 15 22:24:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:21 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.info Apr 15 22:24:21 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:22 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d 1G" returned: 0 in 0.642s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7ba4a8-cc4e-447b-a0b9-fa2ff73cc969]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:22 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.info" returned: 0 in 0.502s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:22 devstack sudo[86871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d Apr 15 22:24:22 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.755s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-ddfdcae0-f1d1-4201-b169-874ba0953593-477fc868-6501-471c-b31a-c2e0049fe01b" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-ddfdcae0-f1d1-4201-b169-874ba0953593-477fc868-6501-471c-b31a-c2e0049fe01b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Creating volume 477fc868-6501-471c-b31a-c2e0049fe01b from snapshot ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-477fc868-6501-471c-b31a-c2e0049fe01b" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:22 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-685137d7-6561-4c3c-9967-b1a1459109a7 tempest-VolumesSnapshotTestJSON-1378274503 None] Create snapshot completed successfully Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-477fc868-6501-471c-b31a-c2e0049fe01b" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] snapshot: ddfdcae0-f1d1-4201-b169-874ba0953593, volume: 477fc868-6501-471c-b31a-c2e0049fe01b, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ae08d2-a77a-4330-b0d6-0529630ddf0a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:22 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 Apr 15 22:24:22 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:22 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" returned: 0 in 0.577s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:22 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d Apr 15 22:24:22 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (93cc9768-3801-49c0-91c8-882235abf345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a6de6f-d409-4e1a-85dc-248f3567fe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a6de6f-d409-4e1a-85dc-248f3567fe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-162852431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee2debe-8281-4c91-9145-46f94cb19f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ac166e2a-b2c1-49fd-94ba-d71251b1c98e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:23Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce6b983-5e79-4b33-97ef-ffbdbd3ff1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ce6b983-5e79-4b33-97ef-ffbdbd3ff1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b70667-7933-4403-9a3f-082b6a248efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b70667-7933-4403-9a3f-082b6a248efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fee2debe-8281-4c91-9145-46f94cb19f48', 'volume_name': 'volume-fee2debe-8281-4c91-9145-46f94cb19f48', 'volume_size': 2, 'snapshot_id': 'ac166e2a-b2c1-49fd-94ba-d71251b1c98e'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843f03b3-f982-4397-a335-089d83cf7318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843f03b3-f982-4397-a335-089d83cf7318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea009f-26e5-4ada-b210-0a92b97e05a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:22 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume fee2debe-8281-4c91-9145-46f94cb19f48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fee2debe-8281-4c91-9145-46f94cb19f48', 'volume_size': 2, 'snapshot_id': 'ac166e2a-b2c1-49fd-94ba-d71251b1c98e'} Apr 15 22:24:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:23 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593" returned: 0 in 0.839s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e948b2a-5f74-488d-9a68-cd689e44fb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd5bcaf-af7c-4554-93c4-c57f59b46169]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:23 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 Apr 15 22:24:23 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:23 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" returned: 1 in 0.550s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Downloaded image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume e3bd641c-37ec-47da-a5c2-7bcd9b46e85d successfully. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd for user 681485b145284b59b78539d38383639c is deleted. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Marking volume e3bd641c-37ec-47da-a5c2-7bcd9b46e85d as bootable. {{(pid=81921) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Copying metadata from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd to e3bd641c-37ec-47da-a5c2-7bcd9b46e85d. {{(pid=81921) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Creating volume glance metadata for volume e3bd641c-37ec-47da-a5c2-7bcd9b46e85d backed by image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81921) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c4e2bfd-1e4a-4143-96d3-22465619dc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991f97d5-e563-412b-b264-397f5e98554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:23 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Volume volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d (e3bd641c-37ec-47da-a5c2-7bcd9b46e85d): created successfully Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991f97d5-e563-412b-b264-397f5e98554e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Flow 'volume_create_manager' (31e49209-aa1b-4709-b90d-448795a62fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:23 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-0c41aede-af12-41fa-b7f5-76549f0a7c16 tempest-VolumesImageMetadata-303053363 None] Created volume successfully. Apr 15 22:24:23 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35" returned: 0 in 0.503s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:24:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:23 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b Apr 15 22:24:23 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Acquiring lock "cinder-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Lock "cinder-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Acquiring lock "cinder-quobyte-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Lock "cinder-quobyte-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" acquired by "delete_volume" :: waited 0.016s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:24 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[da566241-5307-4f79-a78f-ee1368ec04f1]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:24 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d Apr 15 22:24:24 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:26 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" returned: 0 in 2.229s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:26 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b" returned: 0 in 2.802s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[76905e83-ac61-4d40-8a30-57af8bb89a28]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:26 devstack sudo[86913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 Apr 15 22:24:26 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:26 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d Apr 15 22:24:26 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:26 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" returned: 1 in 0.590s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:24:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:27 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d Apr 15 22:24:27 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:27 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35" returned: 0 in 0.635s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35, size 1024.00 MB, duration 2.80 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:24:27 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Converted 1024.00 MB image at 365.15 MB/s Apr 15 22:24:27 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b is being set with open permissions: ugo+rw Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:27 devstack sudo[86925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b Apr 15 22:24:27 devstack sudo[86925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:27 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" returned: 0 in 0.439s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Lock "cinder-quobyte-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d" released by "delete_volume" :: held 3.316s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Created reservations ['cf97af90-cad0-464d-8b18-71fd0b7ff5e5', 'cab4d364-ad06-456a-b03c-2e15e3f530ca', '82522d19-ff8c-4dd4-affa-90334a884f9d', '35a64bb6-86c9-4c90-bd19-a6b9c9832980'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:27 devstack sudo[86925]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b" returned: 0 in 0.520s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-477fc868-6501-471c-b31a-c2e0049fe01b" released by "_copy_volume_from_snapshot" :: held 5.377s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-ddfdcae0-f1d1-4201-b169-874ba0953593-477fc868-6501-471c-b31a-c2e0049fe01b" released by "_create_volume_from_snapshot" :: held 5.404s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.429s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:27 devstack sudo[86929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:27 devstack sudo[86929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.643s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-ac166e2a-b2c1-49fd-94ba-d71251b1c98e-fee2debe-8281-4c91-9145-46f94cb19f48" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ac166e2a-b2c1-49fd-94ba-d71251b1c98e-fee2debe-8281-4c91-9145-46f94cb19f48" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Creating volume fee2debe-8281-4c91-9145-46f94cb19f48 from snapshot ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-fee2debe-8281-4c91-9145-46f94cb19f48" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af62364c-d933-4ccb-ae82-b40c5f511583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477fc868-6501-471c-b31a-c2e0049fe01b', 'volume_size': 1, 'snapshot_id': 'ddfdcae0-f1d1-4201-b169-874ba0953593'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532a1d60-3db3-4dd7-b92e-979c1c7c5b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:27 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Volume volume-477fc868-6501-471c-b31a-c2e0049fe01b (477fc868-6501-471c-b31a-c2e0049fe01b): created successfully Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532a1d60-3db3-4dd7-b92e-979c1c7c5b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Flow 'volume_create_manager' (b865227c-2e6b-4263-98aa-b24c9306a7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-fee2debe-8281-4c91-9145-46f94cb19f48" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] snapshot: ac166e2a-b2c1-49fd-94ba-d71251b1c98e, volume: fee2debe-8281-4c91-9145-46f94cb19f48, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b78da-085a-4826-a848-f10b1a1f60ee]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:27 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9e71950d-f0ba-407a-ad98-b878d736135c tempest-VolumesDeleteCascade-266917969 None] Created volume successfully. Apr 15 22:24:27 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e Apr 15 22:24:27 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:28 devstack sudo[86929]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.533s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:28 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Deleted volume successfully. Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6b84c962-da64-4af6-82b0-ab4855afd2d2 tempest-VolumesImageMetadata-303053363 None] Lock "cinder-e3bd641c-37ec-47da-a5c2-7bcd9b46e85d-delete_volume" released by "delete_volume" :: held 4.093s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:28 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e" returned: 0 in 0.509s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb786e38-2f9b-405b-867c-54aff48e3af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b743f-1e11-40bc-91a2-7bdf3a62d8c2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:28 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 Apr 15 22:24:28 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-8e948b2a-5f74-488d-9a68-cd689e44fb35-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-8e948b2a-5f74-488d-9a68-cd689e44fb35-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Performing cascade delete. {{(pid=81921) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-ddfdcae0-f1d1-4201-b169-874ba0953593-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-ddfdcae0-f1d1-4201-b169-874ba0953593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-8e948b2a-5f74-488d-9a68-cd689e44fb35" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-8e948b2a-5f74-488d-9a68-cd689e44fb35" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-ddfdcae0-f1d1-4201-b169-874ba0953593" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:28 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-ddfdcae0-f1d1-4201-b169-874ba0953593" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Deleting offline snapshot ddfdcae0-f1d1-4201-b169-874ba0953593 of volume 8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] snapshot_file for this snap is: volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5" returned: 0 in 0.595s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bfe902f-45ed-42f2-85bb-6157096b938f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:28 devstack sudo[86942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 Apr 15 22:24:28 devstack sudo[86942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:28 devstack sudo[86943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 Apr 15 22:24:28 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:29 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593" returned: 0 in 0.696s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e948b2a-5f74-488d-9a68-cd689e44fb35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0662ec86-6a03-406e-8d70-c9d0764a0079]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:29 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 Apr 15 22:24:29 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:31 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35" returned: 0 in 2.311s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:31 devstack sudo[86968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 Apr 15 22:24:31 devstack sudo[86942]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:31 devstack sudo[86968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48" returned: 0 in 3.069s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:31 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9081e890-dd5d-4bf7-b99d-528f19eba87f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:32 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 Apr 15 22:24:32 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:32 devstack sudo[86968]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593" returned: 0 in 0.685s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:32 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593 Apr 15 22:24:32 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:33 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5" returned: 0 in 1.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5, size 1024.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:24:33 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Converted 1024.00 MB image at 333.51 MB/s Apr 15 22:24:33 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 is being set with open permissions: ugo+rw Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:33 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35.ddfdcae0-f1d1-4201-b169-874ba0953593" returned: 0 in 0.947s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:33 devstack sudo[86995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 Apr 15 22:24:33 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-ddfdcae0-f1d1-4201-b169-874ba0953593" released by "_delete_snapshot" :: held 4.717s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-8e948b2a-5f74-488d-9a68-cd689e44fb35" released by "delete_snapshot" :: held 4.729s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Created reservations ['0bc3bb50-d8a1-43df-a583-4264c4c53bfc', 'c20eaa9d-af88-4644-95e7-38ac30ce61de', '12d2d4c2-7ad9-4ee3-850b-d9082bf33fc9', '36663ad8-78a8-4838-b01f-2c3c58fccb62'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Delete snapshot completed successfully. Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-ddfdcae0-f1d1-4201-b169-874ba0953593-delete_snapshot" released by "delete_snapshot" :: held 4.939s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Snapshots deleted, issuing volume delete {{(pid=81921) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-8e948b2a-5f74-488d-9a68-cd689e44fb35" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-8e948b2a-5f74-488d-9a68-cd689e44fb35" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[78540c1a-30f0-4fff-92cc-bfb27861f65f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:33 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 Apr 15 22:24:33 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:34 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48" returned: 0 in 0.798s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-fee2debe-8281-4c91-9145-46f94cb19f48" released by "_copy_volume_from_snapshot" :: held 6.577s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ac166e2a-b2c1-49fd-94ba-d71251b1c98e-fee2debe-8281-4c91-9145-46f94cb19f48" released by "_create_volume_from_snapshot" :: held 6.617s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.638s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcea009f-26e5-4ada-b210-0a92b97e05a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee2debe-8281-4c91-9145-46f94cb19f48', 'volume_size': 2, 'snapshot_id': 'ac166e2a-b2c1-49fd-94ba-d71251b1c98e'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26b0d87-a2ce-4e2d-a428-eeb8a24efe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:34 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume volume-fee2debe-8281-4c91-9145-46f94cb19f48 (fee2debe-8281-4c91-9145-46f94cb19f48): created successfully Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26b0d87-a2ce-4e2d-a428-eeb8a24efe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (93cc9768-3801-49c0-91c8-882235abf345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:34 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-94538d22-d6f8-43d4-b21e-8fdc4a7b5c47 tempest-VolumesSnapshotTestJSON-1378274503 None] Created volume successfully. Apr 15 22:24:34 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35" returned: 0 in 0.837s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:34 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35 Apr 15 22:24:34 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Flow 'volume_create_manager' (fbfa2496-c630-4e43-bbd6-0515af14f915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0077aae-f5d7-45a8-9410-f9d75898a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0077aae-f5d7-45a8-9410-f9d75898a93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-595176229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d575f811-322f-4b1b-ab17-841734b160b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5ca723b937404aa11ec608e84eab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:35Z,use_quota=True,user_id='fe8f27ed8404491a8c8c305e6d2362bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2173f9ae-3f7b-4428-8200-03a427105d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2173f9ae-3f7b-4428-8200-03a427105d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357248d0-9bca-4d93-8e2e-0cacbac8475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (357248d0-9bca-4d93-8e2e-0cacbac8475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd575f811-322f-4b1b-ab17-841734b160b8', 'volume_name': 'volume-d575f811-322f-4b1b-ab17-841734b160b8', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfc9a78-319e-4f12-8c71-d2d21e2d41ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dfc9a78-319e-4f12-8c71-d2d21e2d41ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f9f6cd-1387-4198-8bff-7237edfb75a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:34 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Volume d575f811-322f-4b1b-ab17-841734b160b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d575f811-322f-4b1b-ab17-841734b160b8', 'volume_size': 1} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-595176229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d575f811-322f-4b1b-ab17-841734b160b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5ca723b937404aa11ec608e84eab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:35Z,use_quota=True,user_id='fe8f27ed8404491a8c8c305e6d2362bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Creating volume d575f811-322f-4b1b-ab17-841734b160b8 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:34 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:34 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 1073741824 Apr 15 22:24:34 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:35 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e948b2a-5f74-488d-9a68-cd689e44fb35" returned: 0 in 0.519s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-8e948b2a-5f74-488d-9a68-cd689e44fb35" released by "delete_volume" :: held 1.408s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-fee2debe-8281-4c91-9145-46f94cb19f48-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Created reservations ['152a17af-eed3-4735-9e80-461ccc910916', 'ddd5e5f0-4515-4d72-9c90-3af730f31448', '3d24a677-7ba1-4cb6-8cef-46c79b7c80fa', 'c07137fb-92b6-4394-9488-de85b2839cf7'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-fee2debe-8281-4c91-9145-46f94cb19f48-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-fee2debe-8281-4c91-9145-46f94cb19f48" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-fee2debe-8281-4c91-9145-46f94cb19f48" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd7bdc3-8e16-4902-9941-ba4b70b0ec3f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:35 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 1073741824" returned: 0 in 0.619s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:35 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:35 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:35 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 Apr 15 22:24:35 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 Apr 15 22:24:35 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:35 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-477fc868-6501-471c-b31a-c2e0049fe01b-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-477fc868-6501-471c-b31a-c2e0049fe01b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "cinder-quobyte-477fc868-6501-471c-b31a-c2e0049fe01b" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-477fc868-6501-471c-b31a-c2e0049fe01b" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f3c00-b54d-4a90-86aa-1b18aca29277]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:35 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48" returned: 0 in 0.699s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:35 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:35 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b Apr 15 22:24:35 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:35 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8" returned: 0 in 0.670s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.735s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:36 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48 Apr 15 22:24:36 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=180,cinder:SELECT=147,cinder:INSERT=48,cinder:DELETE=15 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:24:36 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Deleted volume successfully. Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f9f6cd-1387-4198-8bff-7237edfb75a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d575f811-322f-4b1b-ab17-841734b160b8', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f005c5-af6f-46e4-9992-a00057fc81b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=146,cinder:UPDATE=163,cinder:INSERT=48,cinder:DELETE=15 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4c4f7fb3-5fdb-4cea-9cdd-e52529448183 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-8e948b2a-5f74-488d-9a68-cd689e44fb35-delete_volume" released by "delete_volume" :: held 7.419s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:36 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Volume volume-d575f811-322f-4b1b-ab17-841734b160b8 (d575f811-322f-4b1b-ab17-841734b160b8): created successfully Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25f005c5-af6f-46e4-9992-a00057fc81b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Flow 'volume_create_manager' (fbfa2496-c630-4e43-bbd6-0515af14f915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:36 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4e73e123-6b4f-437a-bcaa-64da358c9ff1 tempest-VolumesTransfersV355Test-400948042 None] Created volume successfully. Apr 15 22:24:36 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b" returned: 0 in 0.572s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:36 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b Apr 15 22:24:36 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:36 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fee2debe-8281-4c91-9145-46f94cb19f48" returned: 0 in 0.624s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-fee2debe-8281-4c91-9145-46f94cb19f48" released by "delete_volume" :: held 1.377s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['5d4945d1-4ebb-40bc-bf0f-9862f84c1320', '9a542966-9315-40a6-bf18-e7f90bdd8587', 'a581b0f0-1ae9-47d1-be7b-68552010eb6e', 'be2aed16-49e1-42b4-b75d-ede1a5ae827a'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:36 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:36 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:37 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-477fc868-6501-471c-b31a-c2e0049fe01b" returned: 0 in 0.559s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-quobyte-477fc868-6501-471c-b31a-c2e0049fe01b" released by "delete_volume" :: held 1.160s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Created reservations ['5abd3eee-e6d9-41e0-8491-bbdb56288c89', '48982da1-f059-4d35-b8b5-8184da84b5cb', '42fde3e9-d729-46e6-9539-aee822610a35', '51ef5f9a-99f7-4975-8db6-d56147b2dd1a'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9c77a3f4-ab9a-46a5-9762-58332af63e3c tempest-VolumesTransfersV355Test-960477910 None] Transfer volume completed successfully. Apr 15 22:24:37 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:37 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:37 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Deleted volume successfully. Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c44488fb-342e-4277-a7a2-6d6c43f80a34 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-fee2debe-8281-4c91-9145-46f94cb19f48-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-ac166e2a-b2c1-49fd-94ba-d71251b1c98e-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-ac166e2a-b2c1-49fd-94ba-d71251b1c98e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-bb786e38-2f9b-405b-867c-54aff48e3af5" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-bb786e38-2f9b-405b-867c-54aff48e3af5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-ac166e2a-b2c1-49fd-94ba-d71251b1c98e" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ac166e2a-b2c1-49fd-94ba-d71251b1c98e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Deleting offline snapshot ac166e2a-b2c1-49fd-94ba-d71251b1c98e of volume bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] snapshot_file for this snap is: volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d34e6-b913-4713-838b-e61d5586654e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:37 devstack sudo[87046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e Apr 15 22:24:37 devstack sudo[87046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:37 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Deleted volume successfully. Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a50cddcd-28ce-4560-9ecd-0561511ecc78 tempest-VolumesDeleteCascade-266917969 None] Lock "cinder-477fc868-6501-471c-b31a-c2e0049fe01b-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Acquiring lock "cinder-d575f811-322f-4b1b-ab17-841734b160b8-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-d575f811-322f-4b1b-ab17-841734b160b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Acquiring lock "cinder-quobyte-d575f811-322f-4b1b-ab17-841734b160b8" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-quobyte-d575f811-322f-4b1b-ab17-841734b160b8" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:38 devstack sudo[87046]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e" returned: 0 in 0.614s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb786e38-2f9b-405b-867c-54aff48e3af5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd256dc-4dfd-499e-8d29-9ba6726b61df]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[07444fc5-cd49-482f-b105-c8e31c7d5d71]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:38 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 Apr 15 22:24:38 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:38 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 Apr 15 22:24:38 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:38 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8" returned: 0 in 0.546s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:38 devstack sudo[87062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8 Apr 15 22:24:38 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:38 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5" returned: 0 in 0.638s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:38 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e Apr 15 22:24:38 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:39 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d575f811-322f-4b1b-ab17-841734b160b8" returned: 0 in 0.923s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-quobyte-d575f811-322f-4b1b-ab17-841734b160b8" released by "delete_volume" :: held 1.533s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Created reservations ['25d009ce-dcd9-49be-91f8-a60290b99e1a', '026eb544-9579-44dd-b241-e1b67668fa4e', '716c0b2f-31e2-4a87-8d8c-658b1a2d5330', '7b035842-dee5-4ae5-b802-909f2c97adbc'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:39 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:39 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:39 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e" returned: 0 in 1.207s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:39 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e Apr 15 22:24:39 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:40 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.750s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Deleted volume successfully. Apr 15 22:24:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cd879895-a9bb-4021-9eb7-6d6d8037be72 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-d575f811-322f-4b1b-ab17-841734b160b8-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:40 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5.ac166e2a-b2c1-49fd-94ba-d71251b1c98e" returned: 0 in 0.939s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ac166e2a-b2c1-49fd-94ba-d71251b1c98e" released by "_delete_snapshot" :: held 3.479s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-bb786e38-2f9b-405b-867c-54aff48e3af5" released by "delete_snapshot" :: held 3.497s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Flow 'volume_create_manager' (a5cda3d0-4f39-45c4-80cd-f3eb7eb47719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3ba948-3c58-462c-8c09-0394d139a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3ba948-3c58-462c-8c09-0394d139a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1063804372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c25f2f-c0dd-4cfc-b628-2734290f0ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5ca723b937404aa11ec608e84eab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:41Z,use_quota=True,user_id='fe8f27ed8404491a8c8c305e6d2362bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f619c474-2329-4cd5-8cab-6d93b1a52334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f619c474-2329-4cd5-8cab-6d93b1a52334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e317dc35-a8db-4ea3-97eb-fd23e02beb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e317dc35-a8db-4ea3-97eb-fd23e02beb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c25f2f-c0dd-4cfc-b628-2734290f0ed2', 'volume_name': 'volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a42bc92-418a-4a49-b885-2fe0f9bbcba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a42bc92-418a-4a49-b885-2fe0f9bbcba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c450ed-efc3-4c31-8877-73450b3b1da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Volume 21c25f2f-c0dd-4cfc-b628-2734290f0ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2', 'volume_size': 1} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1063804372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c25f2f-c0dd-4cfc-b628-2734290f0ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff5ca723b937404aa11ec608e84eab3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:41Z,use_quota=True,user_id='fe8f27ed8404491a8c8c305e6d2362bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Creating volume 21c25f2f-c0dd-4cfc-b628-2734290f0ed2 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:41 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['dabff6d8-62fc-4101-9678-4a16a4e6efa8', '4d96f71f-a207-4f70-a67c-e1c1fcb56492', '77f5d4f4-0cc4-42a8-bea2-d601d35d25f0', '28d65a62-bb3a-4b52-97c5-92d9322bb94f'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:41 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 1073741824 Apr 15 22:24:41 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Flow 'volume_create_manager' (a4e43de8-15e0-4690-813f-06a7b25d65a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2317eb30-c3b6-4a94-9af0-2ac5e9ea3589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2317eb30-c3b6-4a94-9af0-2ac5e9ea3589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2029387588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a853ebd4-82b1-427e-8d38-40caa33a4ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c38282721ab494988e7ddd92cd3a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:41Z,use_quota=True,user_id='dd3b8fef2dc4496990211b257a4cdcd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e78a91-9bf1-4fee-8656-b60671a37408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e78a91-9bf1-4fee-8656-b60671a37408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bdda3a-d1ba-4d21-b030-d8a80c5adf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bdda3a-d1ba-4d21-b030-d8a80c5adf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a853ebd4-82b1-427e-8d38-40caa33a4ac0', 'volume_name': 'volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0', 'volume_size': 2}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba7613c-55d9-4bdb-9d4a-1ee227d3ea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba7613c-55d9-4bdb-9d4a-1ee227d3ea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9b2a36-a880-496c-92ff-f5e21f6ee2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Volume a853ebd4-82b1-427e-8d38-40caa33a4ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0', 'volume_size': 2} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Delete snapshot completed successfully. Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6124178e-9aa5-4ac7-a0b3-71711ec42afe tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-ac166e2a-b2c1-49fd-94ba-d71251b1c98e-delete_snapshot" released by "delete_snapshot" :: held 3.919s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:41 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 1073741824" returned: 0 in 0.612s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:41 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 Apr 15 22:24:41 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-bb786e38-2f9b-405b-867c-54aff48e3af5-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-bb786e38-2f9b-405b-867c-54aff48e3af5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-bb786e38-2f9b-405b-867c-54aff48e3af5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-bb786e38-2f9b-405b-867c-54aff48e3af5" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6950f95c-16e8-4e8a-971f-a1c8fdc4940f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:42 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.023s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2029387588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a853ebd4-82b1-427e-8d38-40caa33a4ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c38282721ab494988e7ddd92cd3a897',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:41Z,use_quota=True,user_id='dd3b8fef2dc4496990211b257a4cdcd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Creating volume a853ebd4-82b1-427e-8d38-40caa33a4ac0 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:42 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 Apr 15 22:24:42 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:42 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 2147483648 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:42 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 2147483648 Apr 15 22:24:42 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c450ed-efc3-4c31-8877-73450b3b1da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987d1767-5f10-4e44-bd64-2aec66d4f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:42 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Volume volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 (21c25f2f-c0dd-4cfc-b628-2734290f0ed2): created successfully Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987d1767-5f10-4e44-bd64-2aec66d4f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Flow 'volume_create_manager' (a5cda3d0-4f39-45c4-80cd-f3eb7eb47719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-71b342ff-cb35-41da-bb10-18f245f390d4 tempest-VolumesTransfersV355Test-400948042 None] Created volume successfully. Apr 15 22:24:43 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5" returned: 0 in 0.743s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:43 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5 Apr 15 22:24:43 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:43 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 2147483648" returned: 0 in 0.849s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:43 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 Apr 15 22:24:43 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Acquiring lock "cinder-21c25f2f-c0dd-4cfc-b628-2734290f0ed2-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-21c25f2f-c0dd-4cfc-b628-2734290f0ed2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Acquiring lock "cinder-quobyte-21c25f2f-c0dd-4cfc-b628-2734290f0ed2" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-quobyte-21c25f2f-c0dd-4cfc-b628-2734290f0ed2" acquired by "delete_volume" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[39735cb0-c212-4380-a25f-facf90b7ca91]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:43 devstack sudo[87136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 Apr 15 22:24:43 devstack sudo[87136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:44 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bb786e38-2f9b-405b-867c-54aff48e3af5" returned: 0 in 1.032s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-bb786e38-2f9b-405b-867c-54aff48e3af5" released by "delete_volume" :: held 1.919s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['79dfe920-cc96-4bce-815e-ea60d927244e', '3ac06e98-829f-4c25-9eab-6bc4207e2e81', '2a1170c0-e9b8-47ea-8efe-30f201b1975f', 'b15aac92-075e-4eb5-8286-47de9d711ae2'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:44 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:44 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:44 devstack sudo[87136]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2" returned: 0 in 0.731s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:44 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0" returned: 0 in 1.044s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:44 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2 Apr 15 22:24:44 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9b2a36-a880-496c-92ff-f5e21f6ee2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0', 'volume_size': 2}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e45174-79c7-44f9-b567-99df22e10ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Volume volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 (a853ebd4-82b1-427e-8d38-40caa33a4ac0): created successfully Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e45174-79c7-44f9-b567-99df22e10ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Flow 'volume_create_manager' (a4e43de8-15e0-4690-813f-06a7b25d65a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:44 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-22b68599-1661-4863-ac65-3695a30d3895 tempest-VolumesCloneNegativeTest-831337116 None] Created volume successfully. Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (09f8ca25-6db5-4682-be5e-a3a469628e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9569b798-29eb-446b-b281-1d00f2863491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Acquiring lock "cinder-a853ebd4-82b1-427e-8d38-40caa33a4ac0-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9569b798-29eb-446b-b281-1d00f2863491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2050560582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c599f2-b2f3-4a8e-b60a-54708702b752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:45Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3791fa-35ec-4d1d-8a6d-eb1fff39f8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3791fa-35ec-4d1d-8a6d-eb1fff39f8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1a00c7-191c-43c1-9dc4-dc1288ace981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1a00c7-191c-43c1-9dc4-dc1288ace981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c599f2-b2f3-4a8e-b60a-54708702b752', 'volume_name': 'volume-86c599f2-b2f3-4a8e-b60a-54708702b752', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248e1623-695b-4fb0-be81-2c04d71f6c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:44 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248e1623-695b-4fb0-be81-2c04d71f6c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62715e7-0693-4d58-b938-32924b829907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume 86c599f2-b2f3-4a8e-b60a-54708702b752: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c599f2-b2f3-4a8e-b60a-54708702b752', 'volume_size': 1} Apr 15 22:24:44 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2050560582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c599f2-b2f3-4a8e-b60a-54708702b752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:45Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Creating volume 86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:44 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.755s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-21c25f2f-c0dd-4cfc-b628-2734290f0ed2" returned: 0 in 0.606s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:44 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Deleted volume successfully. Apr 15 22:24:44 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 1073741824 Apr 15 22:24:44 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Lock "cinder-a853ebd4-82b1-427e-8d38-40caa33a4ac0-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-quobyte-21c25f2f-c0dd-4cfc-b628-2734290f0ed2" released by "delete_volume" :: held 1.391s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c6d0d186-2cf6-420b-bf30-b675f49fda3c tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-bb786e38-2f9b-405b-867c-54aff48e3af5-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Acquiring lock "cinder-quobyte-a853ebd4-82b1-427e-8d38-40caa33a4ac0" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Lock "cinder-quobyte-a853ebd4-82b1-427e-8d38-40caa33a4ac0" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ff583e-d098-4086-99e2-1ab50c8c4edc]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Created reservations ['6b167daa-8027-4509-90f5-0e61abd357cf', '4553df30-9a5e-42bc-8d9e-2f60214416f8', 'd6bdeeac-f62b-4b59-987a-df1c7cc1fcec', 'fcf38c62-de1a-494d-bb76-9b5db431e2b8'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:45 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 Apr 15 22:24:45 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:45 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:45 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:45 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0" returned: 0 in 0.648s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:45 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0 Apr 15 22:24:45 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:45 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 1073741824" returned: 0 in 0.806s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:45 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 Apr 15 22:24:45 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:45 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.794s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Deleted volume successfully. Apr 15 22:24:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a598604c-3454-431b-95c0-25cd2f1e8263 tempest-VolumesTransfersV355Test-1046281158 None] Lock "cinder-21c25f2f-c0dd-4cfc-b628-2734290f0ed2-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:46 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a853ebd4-82b1-427e-8d38-40caa33a4ac0" returned: 0 in 0.573s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Lock "cinder-quobyte-a853ebd4-82b1-427e-8d38-40caa33a4ac0" released by "delete_volume" :: held 1.257s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Created reservations ['2bc5637d-9b43-4593-9564-76097d8951a3', '614f0987-9517-401d-af93-45c9aa559f5b', '56bb409e-4ec0-4265-9b1b-c77bc6777102', '3466044a-d7f1-4c57-b1dd-7d11b56caf8d'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:46 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752" returned: 0 in 0.559s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62715e7-0693-4d58-b938-32924b829907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c599f2-b2f3-4a8e-b60a-54708702b752', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c846851-eeba-4f0e-866f-79462c8882ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:46 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Volume volume-86c599f2-b2f3-4a8e-b60a-54708702b752 (86c599f2-b2f3-4a8e-b60a-54708702b752): created successfully Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c846851-eeba-4f0e-866f-79462c8882ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (09f8ca25-6db5-4682-be5e-a3a469628e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:46 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-44d61a36-688b-45ca-8928-680751b10421 tempest-VolumesSnapshotTestJSON-1378274503 None] Created volume successfully. Apr 15 22:24:46 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:46 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:46 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.534s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:46 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Deleted volume successfully. Apr 15 22:24:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ed99ac38-3eef-4caa-8d61-abe495a51c5d tempest-VolumesCloneNegativeTest-831337116 None] Lock "cinder-a853ebd4-82b1-427e-8d38-40caa33a4ac0-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Creating offline snapshot ff69f203-cd19-468b-93a9-09dc45581da5 of volume 86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:24:47 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4f9489-31b1-4395-a3ca-b99352aee4a6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:47 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 Apr 15 22:24:47 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:47 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752" returned: 0 in 0.714s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:47 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 1G Apr 15 22:24:47 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:48 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 1G" returned: 0 in 0.874s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c599f2-b2f3-4a8e-b60a-54708702b752 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:48 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c599f2-b2f3-4a8e-b60a-54708702b752 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 Apr 15 22:24:48 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:49 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86c599f2-b2f3-4a8e-b60a-54708702b752 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5" returned: 0 in 0.646s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:49 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 is being set with open permissions: ugo+rw Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:49 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 Apr 15 22:24:49 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Flow 'volume_create_manager' (54f4e37a-ab51-4d8d-911b-87b5d5495edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07724cc-62a4-4cb1-a0c7-1a949f987907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07724cc-62a4-4cb1-a0c7-1a949f987907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-264507718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7831f1-1ab5-4079-b876-cd71c4f4bee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d82e47484774ecd9e253c005e89aef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:50Z,use_quota=True,user_id='ef0d5dec9a794ebf82102a07941c11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750ee1f0-44ed-4079-ab05-8ed287802fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (750ee1f0-44ed-4079-ab05-8ed287802fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad5a849-e66a-4504-93f9-92af51986860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.image.glance [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Creating Keystone auth plugin from conf {{(pid=81921) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Flow 'volume_create_manager' (8470d632-114e-4357-889a-f82a5f15cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932c0296-72c5-4384-9493-6c49c08dd721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932c0296-72c5-4384-9493-6c49c08dd721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1596918744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea695e-0254-4a0f-a42d-6ac0b19e8ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edee993a5f44908bd21697705fda9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:50Z,use_quota=True,user_id='1d14aa9619bf4958a5e12191c8ab67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecf37c6-5ef7-4390-955e-0b523a3aef8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecf37c6-5ef7-4390-955e-0b523a3aef8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c373307-0493-44f5-9624-d35fbbf61114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c373307-0493-44f5-9624-d35fbbf61114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dea695e-0254-4a0f-a42d-6ac0b19e8ee1', 'volume_name': 'volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e853a5-72d2-4bef-a87f-556fb736492d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e853a5-72d2-4bef-a87f-556fb736492d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139e1e5b-6c9e-4698-bfde-3aa7f2a37390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:49 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Volume 9dea695e-0254-4a0f-a42d-6ac0b19e8ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1', 'volume_size': 1} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:49 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5" returned: 0 in 0.584s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:49 devstack sudo[87221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.info Apr 15 22:24:49 devstack sudo[87221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad5a849-e66a-4504-93f9-92af51986860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da7831f1-1ab5-4079-b876-cd71c4f4bee7', 'volume_name': 'volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7d238b-9feb-435c-9422-262518966b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7d238b-9feb-435c-9422-262518966b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675a16ef-0c3d-4b88-9b6b-aa3827798431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:50 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Volume da7831f1-1ab5-4079-b876-cd71c4f4bee7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Trying to clone da7831f1-1ab5-4079-b876-cd71c4f4bee7 from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]). {{(pid=81921) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 22:24:50 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Image download 20.69 MB at 20.69 MB/s Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aa4da6-719d-449f-902a-8e6757bc5c36]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:50 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD Apr 15 22:24:50 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:50 devstack sudo[87221]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.info" returned: 0 in 0.636s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:50 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.info is being set with open permissions: ugo+rw Apr 15 22:24:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:50 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.info Apr 15 22:24:50 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:51 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD" returned: 0 in 0.700s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd is fetched for user ef0d5dec9a794ebf82102a07941c11fd. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 22:24:51 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.info" returned: 0 in 0.572s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.128s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1596918744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea695e-0254-4a0f-a42d-6ac0b19e8ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edee993a5f44908bd21697705fda9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:50Z,use_quota=True,user_id='1d14aa9619bf4958a5e12191c8ab67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Creating volume 9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:51 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:51 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 1073741824 Apr 15 22:24:51 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:51 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c57fa007-615b-4b8b-9839-27df646bb2aa tempest-VolumesSnapshotTestJSON-1378274503 None] Create snapshot completed successfully Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[89810b13-7319-4c49-a816-75f9e2bed5ff]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:51 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD Apr 15 22:24:51 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Flow 'volume_create_manager' (f58bdada-60b8-4975-b880-db8c1196d543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24116af3-8eba-40ce-8bb2-f05523dfa44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24116af3-8eba-40ce-8bb2-f05523dfa44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1580464376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b38a434-4281-4e4e-be2e-580a53eaf05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890d02fece4f434fb8ccb5dce45aa4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:52Z,use_quota=True,user_id='444e05b3b54b49b98249ab27764011bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f450d812-fed9-4492-97fe-7bdfc05937c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f450d812-fed9-4492-97fe-7bdfc05937c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551a431d-882d-4e5a-8866-f7612a498d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551a431d-882d-4e5a-8866-f7612a498d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b38a434-4281-4e4e-be2e-580a53eaf05a', 'volume_name': 'volume-8b38a434-4281-4e4e-be2e-580a53eaf05a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de511fd-7256-449f-8969-e287f88f5519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de511fd-7256-449f-8969-e287f88f5519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dc4d35-a421-40e5-a4a7-fcbe96c87aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:51 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Volume 8b38a434-4281-4e4e-be2e-580a53eaf05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b38a434-4281-4e4e-be2e-580a53eaf05a', 'volume_size': 1} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:51 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD" returned: 0 in 0.570s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:51 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 1073741824" returned: 0 in 0.648s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:51 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 Apr 15 22:24:51 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:52 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1" returned: 0 in 0.416s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1580464376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b38a434-4281-4e4e-be2e-580a53eaf05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890d02fece4f434fb8ccb5dce45aa4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:52Z,use_quota=True,user_id='444e05b3b54b49b98249ab27764011bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Creating volume 8b38a434-4281-4e4e-be2e-580a53eaf05a {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:52 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139e1e5b-6c9e-4698-bfde-3aa7f2a37390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7a1e8e-cc09-4e41-a328-28f970505c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:52 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a 1073741824 Apr 15 22:24:52 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:52 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Volume volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 (9dea695e-0254-4a0f-a42d-6ac0b19e8ee1): created successfully Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f7a1e8e-cc09-4e41-a328-28f970505c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Flow 'volume_create_manager' (8470d632-114e-4357-889a-f82a5f15cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:52 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-95f7a160-6c50-46b7-bf3b-c9c14505e906 tempest-ServersNegativeTestJSON-919857815 None] Created volume successfully. Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (4105398a-98e9-4c97-bcb6-44576f585d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8594b0a7-bf54-44d1-8051-b53aac007c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8594b0a7-bf54-44d1-8051-b53aac007c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-452693438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ed8224-0f57-49af-ab51-8ad0d7f1459d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c12f749dcee4730812bd46909eb8ab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ff69f203-cd19-468b-93a9-09dc45581da5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:53Z,use_quota=True,user_id='3f783745b70a4694b5aca9cc82fd14dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14822a1c-4f9d-4b81-9d92-4e5cddd5f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14822a1c-4f9d-4b81-9d92-4e5cddd5f865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0c9f88-fb6e-408a-aa2a-0305220deee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0c9f88-fb6e-408a-aa2a-0305220deee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61ed8224-0f57-49af-ab51-8ad0d7f1459d', 'volume_name': 'volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d', 'volume_size': 1, 'snapshot_id': 'ff69f203-cd19-468b-93a9-09dc45581da5'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc948a37-cad8-4669-97f2-b5c992071073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc948a37-cad8-4669-97f2-b5c992071073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f754aa-b1bd-4cdc-bcd8-109198d8aae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:52 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Volume 61ed8224-0f57-49af-ab51-8ad0d7f1459d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d', 'volume_size': 1, 'snapshot_id': 'ff69f203-cd19-468b-93a9-09dc45581da5'} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:52 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a 1073741824" returned: 0 in 0.552s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:52 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a Apr 15 22:24:52 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:53 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-264507718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7831f1-1ab5-4079-b876-cd71c4f4bee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d82e47484774ecd9e253c005e89aef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:50Z,use_quota=True,user_id='ef0d5dec9a794ebf82102a07941c11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Creating volume da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:53 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dc4d35-a421-40e5-a4a7-fcbe96c87aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b38a434-4281-4e4e-be2e-580a53eaf05a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7466fae5-b4c0-49f3-afa1-d06e4b62508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:53 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 1073741824 Apr 15 22:24:53 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:53 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Volume volume-8b38a434-4281-4e4e-be2e-580a53eaf05a (8b38a434-4281-4e4e-be2e-580a53eaf05a): created successfully Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7466fae5-b4c0-49f3-afa1-d06e4b62508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Flow 'volume_create_manager' (f58bdada-60b8-4975-b880-db8c1196d543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4077c86f-da7e-461e-af77-df8aa58e10a7 tempest-VolumesTransfersV357Test-1718805449 None] Created volume successfully. Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Flow 'volume_create_manager' (5c335d39-c413-451e-8c73-f2fbd4e7c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d871d9-0cfc-47bb-8180-409abc520b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d871d9-0cfc-47bb-8180-409abc520b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-502827636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9347588d-5d49-45b3-afeb-9d3926dac9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edee993a5f44908bd21697705fda9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:54Z,use_quota=True,user_id='1d14aa9619bf4958a5e12191c8ab67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36afa304-339c-4d6b-ae34-5c3a4871d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36afa304-339c-4d6b-ae34-5c3a4871d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7217a8-b512-4cf1-8d9e-3d65b91e1d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7217a8-b512-4cf1-8d9e-3d65b91e1d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9347588d-5d49-45b3-afeb-9d3926dac9fd', 'volume_name': 'volume-9347588d-5d49-45b3-afeb-9d3926dac9fd', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa147ae-dd3e-47b9-806b-ab9b7f76d641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa147ae-dd3e-47b9-806b-ab9b7f76d641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9e4b23-3709-4d36-b9ad-28cfa95a32e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:53 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Volume 9347588d-5d49-45b3-afeb-9d3926dac9fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9347588d-5d49-45b3-afeb-9d3926dac9fd', 'volume_size': 1} Apr 15 22:24:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:54 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 1073741824" returned: 0 in 0.657s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:54 devstack sudo[87260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:24:54 devstack sudo[87260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3f89d94c-d310-46f5-aa85-3e8913773bd2 tempest-VolumesTransfersV357Test-692047384 None] Transfer volume completed successfully. Apr 15 22:24:54 devstack sudo[87260]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 0 in 0.425s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.803s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-ff69f203-cd19-468b-93a9-09dc45581da5-61ed8224-0f57-49af-ab51-8ad0d7f1459d" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ff69f203-cd19-468b-93a9-09dc45581da5-61ed8224-0f57-49af-ab51-8ad0d7f1459d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Creating volume 61ed8224-0f57-49af-ab51-8ad0d7f1459d from snapshot ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-61ed8224-0f57-49af-ab51-8ad0d7f1459d" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-61ed8224-0f57-49af-ab51-8ad0d7f1459d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] snapshot: ff69f203-cd19-468b-93a9-09dc45581da5, volume: 61ed8224-0f57-49af-ab51-8ad0d7f1459d, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Attempting download of 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume da7831f1-1ab5-4079-b876-cd71c4f4bee7. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01417b7-5bbd-4d74-81c9-6e472c85738f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cf5b30-7dfb-41d7-92d3-5568d88ae002]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_u3v4lyhy {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:54 devstack sudo[87263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 Apr 15 22:24:54 devstack sudo[87263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:54 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_u3v4lyhy Apr 15 22:24:54 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Acquiring lock "cinder-8b38a434-4281-4e4e-be2e-580a53eaf05a-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-8b38a434-4281-4e4e-be2e-580a53eaf05a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Acquiring lock "cinder-quobyte-8b38a434-4281-4e4e-be2e-580a53eaf05a" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-quobyte-8b38a434-4281-4e4e-be2e-580a53eaf05a" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:24:55 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_u3v4lyhy" returned: 0 in 0.522s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_u3v4lyhy {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[870221c4-ca6c-4805-8892-264b6ff6c244]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:55 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_u3v4lyhy Apr 15 22:24:55 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:55 devstack sudo[87270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a Apr 15 22:24:55 devstack sudo[87270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:55 devstack sudo[87263]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5" returned: 0 in 0.689s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86c599f2-b2f3-4a8e-b60a-54708702b752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c38dd1-1897-4f96-809a-834d79a8f71f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:55 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 Apr 15 22:24:55 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:55 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_u3v4lyhy" returned: 1 in 0.492s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_u3v4lyhy' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f65cbc2-03c3-4ffa-b181-014a57d5d321]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:55 devstack sudo[87270]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a" returned: 0 in 0.511s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:55 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a Apr 15 22:24:55 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:55 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD Apr 15 22:24:55 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:55 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752" returned: 0 in 0.541s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:24:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:55 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d Apr 15 22:24:55 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:56 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8b38a434-4281-4e4e-be2e-580a53eaf05a" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:56 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-quobyte-8b38a434-4281-4e4e-be2e-580a53eaf05a" released by "delete_volume" :: held 1.086s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD" returned: 0 in 0.562s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd was qcow2, converting to raw {{(pid=81921) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:56 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:24:56 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Created reservations ['c4736778-366d-4fa4-916a-2ff2b323c52a', 'b6707cda-7f44-4818-8bf1-f9b2bb96d9ab', '2e2882c3-0d9c-45f3-aa30-a24031e23cf3', 'f9cca15c-2d6e-4d5d-b28b-98b53e4ec9d4'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:56 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:24:56 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:58 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 1.944s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:24:58 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Deleted volume successfully. Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3f61c286-0679-41a2-b65a-5485f7535bbe tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-8b38a434-4281-4e4e-be2e-580a53eaf05a-delete_volume" released by "delete_volume" :: held 3.222s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Flow 'volume_create_manager' (cbdcece7-d8b7-4595-9614-4b6ef9bed8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685efa4d-36f4-470c-b496-7e202506f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685efa4d-36f4-470c-b496-7e202506f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1623857329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b809c-8d7b-453f-be35-84df9ab2ab18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890d02fece4f434fb8ccb5dce45aa4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:58Z,use_quota=True,user_id='444e05b3b54b49b98249ab27764011bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:58 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32872b6b-3299-4f2e-837e-df33c6085e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32872b6b-3299-4f2e-837e-df33c6085e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e2c7b6-4a67-4ab7-8f7b-3a43738ccb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e2c7b6-4a67-4ab7-8f7b-3a43738ccb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0b809c-8d7b-453f-be35-84df9ab2ab18', 'volume_name': 'volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5c59fb-b15d-407a-9580-8b68c3142902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea5c59fb-b15d-407a-9580-8b68c3142902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6fd21f-227e-4380-88d2-44ea77f08f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:58 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Volume 6b0b809c-8d7b-453f-be35-84df9ab2ab18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18', 'volume_size': 1} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d" returned: 0 in 2.755s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc8d111-e2d0-490a-8b6b-e92adf717ae3]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:58 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 0 in 2.447s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_6pnu7uybdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:24:58 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Converted 112.00 MB image at 45.74 MB/s Apr 15 22:24:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:58 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 1G Apr 15 22:24:58 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:58 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 Apr 15 22:24:58 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:59 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 1G" returned: 0 in 0.439s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf01d5d4-b787-44bd-b190-c541cfb6aae3]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:59 devstack sudo[87330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:24:59 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:59 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752" returned: 0 in 0.622s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752, size 1024.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:24:59 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Converted 1024.00 MB image at 371.55 MB/s Apr 15 22:24:59 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d is being set with open permissions: ugo+rw Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:59 devstack sudo[87333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d Apr 15 22:24:59 devstack sudo[87333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:59 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:59 devstack sudo[87333]: pam_unix(sudo:session): session closed for user root Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d" returned: 0 in 0.446s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-61ed8224-0f57-49af-ab51-8ad0d7f1459d" released by "_copy_volume_from_snapshot" :: held 5.146s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ff69f203-cd19-468b-93a9-09dc45581da5-61ed8224-0f57-49af-ab51-8ad0d7f1459d" released by "_create_volume_from_snapshot" :: held 5.168s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.182s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:59 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:24:59 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.673s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-502827636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9347588d-5d49-45b3-afeb-9d3926dac9fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1edee993a5f44908bd21697705fda9c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:54Z,use_quota=True,user_id='1d14aa9619bf4958a5e12191c8ab67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Creating volume 9347588d-5d49-45b3-afeb-9d3926dac9fd {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:24:59 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:24:59 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd 1073741824 Apr 15 22:24:59 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f754aa-b1bd-4cdc-bcd8-109198d8aae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d', 'volume_size': 1, 'snapshot_id': 'ff69f203-cd19-468b-93a9-09dc45581da5'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c68753-b6a2-4700-ad09-17becdc9a038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:24:59 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Volume volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d (61ed8224-0f57-49af-ab51-8ad0d7f1459d): created successfully Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c68753-b6a2-4700-ad09-17becdc9a038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:24:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Flow 'volume_create_manager' (4105398a-98e9-4c97-bcb6-44576f585d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:24:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9269be0b-2383-45a8-9e94-f97dd108492a tempest-VolumesSnapshotTestJSON-1378274503 None] Created volume successfully. Apr 15 22:25:00 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 1 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Downloaded image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume da7831f1-1ab5-4079-b876-cd71c4f4bee7 successfully. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd for user ef0d5dec9a794ebf82102a07941c11fd is deleted. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Marking volume da7831f1-1ab5-4079-b876-cd71c4f4bee7 as bootable. {{(pid=81921) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Copying metadata from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd to da7831f1-1ab5-4079-b876-cd71c4f4bee7. {{(pid=81921) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Creating volume glance metadata for volume da7831f1-1ab5-4079-b876-cd71c4f4bee7 backed by image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81921) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675a16ef-0c3d-4b88-9b6b-aa3827798431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:00 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd56c9-ee92-4c9f-8d29-392ee973f445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd 1073741824" returned: 0 in 0.518s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:00 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Volume volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 (da7831f1-1ab5-4079-b876-cd71c4f4bee7): created successfully Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbd56c9-ee92-4c9f-8d29-392ee973f445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Flow 'volume_create_manager' (54f4e37a-ab51-4d8d-911b-87b5d5495edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-69992da5-60bb-45dc-9ddd-c9230498918e tempest-VolumesExtendTest-707559151 None] Created volume successfully. Apr 15 22:25:00 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd Apr 15 22:25:00 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-61ed8224-0f57-49af-ab51-8ad0d7f1459d-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-61ed8224-0f57-49af-ab51-8ad0d7f1459d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-61ed8224-0f57-49af-ab51-8ad0d7f1459d" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-61ed8224-0f57-49af-ab51-8ad0d7f1459d" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b69ea2c-12df-4aa3-8437-7c3a141d971d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:00 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d Apr 15 22:25:00 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:00 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.141s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1623857329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0b809c-8d7b-453f-be35-84df9ab2ab18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890d02fece4f434fb8ccb5dce45aa4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:24:58Z,use_quota=True,user_id='444e05b3b54b49b98249ab27764011bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Creating volume 6b0b809c-8d7b-453f-be35-84df9ab2ab18 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:00 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b9e4b23-3709-4d36-b9ad-28cfa95a32e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9347588d-5d49-45b3-afeb-9d3926dac9fd', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:00 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 1073741824 Apr 15 22:25:00 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdaf99c6-8342-4dba-b36c-3a787a79386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:00 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Volume volume-9347588d-5d49-45b3-afeb-9d3926dac9fd (9347588d-5d49-45b3-afeb-9d3926dac9fd): created successfully Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdaf99c6-8342-4dba-b36c-3a787a79386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Flow 'volume_create_manager' (5c335d39-c413-451e-8c73-f2fbd4e7c34b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6a962244-5c64-4ad5-8534-42736b7bcc9c tempest-ServersNegativeTestJSON-919857815 None] Created volume successfully. Apr 15 22:25:00 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d" returned: 0 in 0.524s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:00 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d Apr 15 22:25:00 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:01 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 1073741824" returned: 0 in 0.488s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:01 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 Apr 15 22:25:01 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:01 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61ed8224-0f57-49af-ab51-8ad0d7f1459d" returned: 0 in 0.435s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-61ed8224-0f57-49af-ab51-8ad0d7f1459d" released by "delete_volume" :: held 0.986s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['2621bb79-324e-456c-89e2-02cc9a6b3d73', '5386a32c-a2e2-444e-8495-c96203896511', 'bda08636-eec3-464e-921e-bf35f51e4deb', '10b7e823-d84f-4805-b152-35ee3fd4e467'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:01 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:01 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:01 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18" returned: 0 in 0.475s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.044s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6fd21f-227e-4380-88d2-44ea77f08f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7267c2d8-d6dc-4bd2-9c23-856fcf2e5965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:01 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Volume volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 (6b0b809c-8d7b-453f-be35-84df9ab2ab18): created successfully Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7267c2d8-d6dc-4bd2-9c23-856fcf2e5965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Flow 'volume_create_manager' (cbdcece7-d8b7-4595-9614-4b6ef9bed8c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5605636-ce63-4feb-a638-48d5818e367e]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:01 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-45f4961a-b795-4751-b709-7bf01dc1f11c tempest-VolumesTransfersV357Test-1718805449 None] Created volume successfully. Apr 15 22:25:01 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:25:01 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:01 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.519s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:01 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Deleted volume successfully. Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "cinder-9347588d-5d49-45b3-afeb-9d3926dac9fd-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6d9a6697-ada1-4cd0-aded-6b392e7d4a30 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-61ed8224-0f57-49af-ab51-8ad0d7f1459d-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-9347588d-5d49-45b3-afeb-9d3926dac9fd-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "cinder-quobyte-9347588d-5d49-45b3-afeb-9d3926dac9fd" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-quobyte-9347588d-5d49-45b3-afeb-9d3926dac9fd" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3058c75b-323e-407b-b6ba-b10e03a79ee0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:02 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd Apr 15 22:25:02 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:02 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 0 in 0.517s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:02 devstack sudo[87383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:25:02 devstack sudo[87383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-ff69f203-cd19-468b-93a9-09dc45581da5-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-ff69f203-cd19-468b-93a9-09dc45581da5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-86c599f2-b2f3-4a8e-b60a-54708702b752" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-86c599f2-b2f3-4a8e-b60a-54708702b752" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-ff69f203-cd19-468b-93a9-09dc45581da5" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ff69f203-cd19-468b-93a9-09dc45581da5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Deleting offline snapshot ff69f203-cd19-468b-93a9-09dc45581da5 of volume 86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] snapshot_file for this snap is: volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:25:02 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd" returned: 0 in 0.567s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e2f08c-ae45-4e35-a5f8-197c5cdfb8b5]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:02 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd Apr 15 22:25:02 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:02 devstack sudo[87389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 Apr 15 22:25:02 devstack sudo[87389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:02 devstack sudo[87383]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 1 in 0.536s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 2G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 2G" returned: 0 in 0.068s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.164s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:02 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3d656455-8966-449e-8fc5-c259542d9936 tempest-VolumesExtendTest-707559151 None] Extend volume completed successfully. Apr 15 22:25:02 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9347588d-5d49-45b3-afeb-9d3926dac9fd" returned: 0 in 0.459s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Acquiring lock "cinder-6b0b809c-8d7b-453f-be35-84df9ab2ab18-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-quobyte-9347588d-5d49-45b3-afeb-9d3926dac9fd" released by "delete_volume" :: held 1.087s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-6b0b809c-8d7b-453f-be35-84df9ab2ab18-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Acquiring lock "cinder-quobyte-6b0b809c-8d7b-453f-be35-84df9ab2ab18" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Created reservations ['9debb1b2-1320-4ea7-8538-e181e7a47975', '715a96cd-ed0d-45e0-8e6f-934872ed25a9', 'b824f392-b0e1-44b4-b61f-85e2ee01603d', '868ffe9d-c1ca-4789-b57a-cb7b3d38678a'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-quobyte-6b0b809c-8d7b-453f-be35-84df9ab2ab18" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[792d5eb2-51e5-4303-b0a5-d71a9f838f45]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:03 devstack sudo[87389]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5" returned: 0 in 0.624s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86c599f2-b2f3-4a8e-b60a-54708702b752(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c39012-d916-4307-8361-9e71e36156b6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:03 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 Apr 15 22:25:03 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:03 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:03 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:03 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 Apr 15 22:25:03 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:03 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.481s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:03 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18" returned: 0 in 0.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:03 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Deleted volume successfully. Apr 15 22:25:03 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:03 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18 Apr 15 22:25:03 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752" returned: 0 in 0.529s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:03 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 Apr 15 22:25:03 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0c82b73-ff37-4e70-9eb2-4e5171bd1d57 tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-9347588d-5d49-45b3-afeb-9d3926dac9fd-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Acquiring lock "cinder-da7831f1-1ab5-4079-b876-cd71c4f4bee7-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Lock "cinder-da7831f1-1ab5-4079-b876-cd71c4f4bee7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "cinder-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Acquiring lock "cinder-quobyte-da7831f1-1ab5-4079-b876-cd71c4f4bee7" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-da7831f1-1ab5-4079-b876-cd71c4f4bee7" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "cinder-quobyte-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5f3e81-d643-4439-92c2-d1d7a41ff49c]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-quobyte-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1" acquired by "delete_volume" :: waited 0.027s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4830c1ba-96b7-49ae-acbb-b4545263fb6d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:04 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6b0b809c-8d7b-453f-be35-84df9ab2ab18" returned: 0 in 0.597s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-quobyte-6b0b809c-8d7b-453f-be35-84df9ab2ab18" released by "delete_volume" :: held 1.183s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:04 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5" returned: 0 in 0.594s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Created reservations ['427b7439-f01c-4f8e-b132-e80678d863db', '5b0fcde6-336b-466a-aa54-2f36e5943bcd', '8ac8f4e7-5e74-4d94-83bc-c6b029ae69ed', '30495243-5454-4bc5-b2c1-b727b6022031'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:04 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5 Apr 15 22:25:04 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:04 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:25:04 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:04 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 Apr 15 22:25:04 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:04 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:04 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:04 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 0 in 0.559s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:04 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1" returned: 0 in 0.531s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:04 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1 Apr 15 22:25:04 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:04 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752.ff69f203-cd19-468b-93a9-09dc45581da5" returned: 0 in 0.548s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:04 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:25:04 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ff69f203-cd19-468b-93a9-09dc45581da5" released by "_delete_snapshot" :: held 2.390s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-86c599f2-b2f3-4a8e-b60a-54708702b752" released by "delete_snapshot" :: held 2.403s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:04 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Deleted volume successfully. Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['63f99532-b20c-45f0-b827-31df1eb63e24', 'eabe7949-e45b-4275-b5b6-d2bf97a9fc69', 'cc36f5b2-a16d-40b5-8127-b7d7f72b7810', '40597ce0-5b95-4ac5-8b84-ecf1063b27d0'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33ec3671-f441-4deb-a43f-20415030e222 tempest-VolumesTransfersV357Test-1394185694 None] Lock "cinder-6b0b809c-8d7b-453f-be35-84df9ab2ab18-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Delete snapshot completed successfully. Apr 15 22:25:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-50c63ec9-c9b7-4f57-bc5f-e928b693dcab tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-ff69f203-cd19-468b-93a9-09dc45581da5-delete_snapshot" released by "delete_snapshot" :: held 2.500s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:05 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1" returned: 0 in 0.502s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-quobyte-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1" released by "delete_volume" :: held 1.059s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:05 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 1 in 0.534s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:05 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7 Apr 15 22:25:05 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Created reservations ['382eb73a-8b29-4808-b891-3c0ca09fdbe7', '3677082d-b415-4e28-93f0-7f133c18ca76', '40a768ae-954d-46eb-ae35-6504889a2528', '53bd24da-7635-46c8-8128-299db310e089'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:05 devstack sudo[87591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:05 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-86c599f2-b2f3-4a8e-b60a-54708702b752-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-86c599f2-b2f3-4a8e-b60a-54708702b752-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-86c599f2-b2f3-4a8e-b60a-54708702b752" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-86c599f2-b2f3-4a8e-b60a-54708702b752" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebff014-a3b9-4d59-8ad5-d989f8b65a78]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:05 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 Apr 15 22:25:05 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:05 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da7831f1-1ab5-4079-b876-cd71c4f4bee7" returned: 0 in 0.556s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-da7831f1-1ab5-4079-b876-cd71c4f4bee7" released by "delete_volume" :: held 1.700s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Created reservations ['9f536066-9166-4149-9f31-332abefeaa30', 'dc818f9d-9744-4b00-8d22-6da0258ffcd7', '8b7b9dee-f557-495f-aa59-3034c0721ea5', '559e5dad-1d8f-48fc-b69e-e367fabc88db'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:05 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.571s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:05 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:05 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Deleted volume successfully. Apr 15 22:25:06 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:06 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-378daf63-d829-4e65-951b-f0453d400f7a tempest-ServersNegativeTestJSON-919857815 None] Lock "cinder-9dea695e-0254-4a0f-a42d-6ac0b19e8ee1-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:06 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752" returned: 0 in 0.710s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:06 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.529s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:06 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752 Apr 15 22:25:06 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Deleted volume successfully. Apr 15 22:25:06 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-af56a5cb-6474-4bc4-8de8-633e59b84d78 tempest-VolumesExtendTest-707559151 None] Lock "cinder-da7831f1-1ab5-4079-b876-cd71c4f4bee7-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Flow 'volume_create_manager' (f9460a41-0deb-41df-81f0-77779aefb6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b849d75e-8849-4013-b488-811c706571d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b849d75e-8849-4013-b488-811c706571d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2122029701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f2b404-20ed-4929-bd7d-a8eca3273164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d82e47484774ecd9e253c005e89aef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:07Z,use_quota=True,user_id='ef0d5dec9a794ebf82102a07941c11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87827c3a-4660-4753-a036-581cf4d84bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87827c3a-4660-4753-a036-581cf4d84bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6241d4-8101-4ac6-8ba2-99e937170d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b6241d4-8101-4ac6-8ba2-99e937170d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f2b404-20ed-4929-bd7d-a8eca3273164', 'volume_name': 'volume-c6f2b404-20ed-4929-bd7d-a8eca3273164', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652454aa-853f-469b-aad2-d3648995d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652454aa-853f-469b-aad2-d3648995d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a24b8b-dc91-4ed4-ab18-b745054db112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:06 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Volume c6f2b404-20ed-4929-bd7d-a8eca3273164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f2b404-20ed-4929-bd7d-a8eca3273164', 'volume_size': 1} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2122029701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f2b404-20ed-4929-bd7d-a8eca3273164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d82e47484774ecd9e253c005e89aef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:07Z,use_quota=True,user_id='ef0d5dec9a794ebf82102a07941c11fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Creating volume c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:06 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:06 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 1073741824 Apr 15 22:25:06 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:06 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86c599f2-b2f3-4a8e-b60a-54708702b752" returned: 0 in 0.498s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-86c599f2-b2f3-4a8e-b60a-54708702b752" released by "delete_volume" :: held 1.248s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['a02a88c0-d0f3-4af2-8c92-543f0fe46650', 'a7639cc4-5b1d-4e5c-88b5-f3e17f705b95', '711527ec-afc0-4fc1-9c27-fc6a34bccf82', 'f458efa1-ac08-4de7-8f28-8a2af038b617'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:07 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:07 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:07 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 1073741824" returned: 0 in 0.661s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:07 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 Apr 15 22:25:07 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:07 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.555s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:07 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Deleted volume successfully. Apr 15 22:25:07 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7781ab60-97b4-46b4-912e-6eb04afe43a6 tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-86c599f2-b2f3-4a8e-b60a-54708702b752-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-ccda5467-92f5-4c61-a33c-5185b7828244-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-ccda5467-92f5-4c61-a33c-5185b7828244-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "cinder-quobyte-ccda5467-92f5-4c61-a33c-5185b7828244" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ccda5467-92f5-4c61-a33c-5185b7828244" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:08 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164" returned: 0 in 0.825s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a820d6-130a-45d1-a161-6aaba76ea0f2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a24b8b-dc91-4ed4-ab18-b745054db112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f2b404-20ed-4929-bd7d-a8eca3273164', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccdefa9-af3c-4cb5-9847-1a15a79d0261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:08 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Volume volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 (c6f2b404-20ed-4929-bd7d-a8eca3273164): created successfully Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccdefa9-af3c-4cb5-9847-1a15a79d0261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Flow 'volume_create_manager' (f9460a41-0deb-41df-81f0-77779aefb6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e70e5ba9-2f88-4d5a-8da8-362e5afe67ff tempest-VolumesExtendTest-707559151 None] Created volume successfully. Apr 15 22:25:08 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 Apr 15 22:25:08 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Creating offline snapshot f61fc786-4366-46e8-b27f-e1d822d7eeb0 of volume c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[381dba3f-a105-4b9f-ac34-16a15a7d1d22]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:08 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244" returned: 0 in 0.691s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:08 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 Apr 15 22:25:08 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:08 devstack sudo[87683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244 Apr 15 22:25:08 devstack sudo[87683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:09 devstack sudo[87683]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ccda5467-92f5-4c61-a33c-5185b7828244" returned: 0 in 0.588s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-quobyte-ccda5467-92f5-4c61-a33c-5185b7828244" released by "delete_volume" :: held 1.345s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Flow 'volume_create_manager' (12f6013c-fab2-49d2-b40a-7f7f119df942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94511136-3fce-4c7c-bdf7-6ec97075a844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:09 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94511136-3fce-4c7c-bdf7-6ec97075a844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1115662753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573e8239-cb50-4a7f-815d-7f2a870e9e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05b5e3e492d4e978e3230931923724e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:09Z,use_quota=True,user_id='37134ef39d2d4d4bab9760373f3e03f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d1854c-bba0-4b5e-b10f-a19409b8d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d1854c-bba0-4b5e-b10f-a19409b8d738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54047283-0b65-47b4-a3d5-22e9fdaafb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54047283-0b65-47b4-a3d5-22e9fdaafb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '573e8239-cb50-4a7f-815d-7f2a870e9e37', 'volume_name': 'volume-573e8239-cb50-4a7f-815d-7f2a870e9e37', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677928b9-cfc0-4ab8-adcd-3c657e863034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677928b9-cfc0-4ab8-adcd-3c657e863034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9cf97d-eb48-407c-aaf5-9826fb94bdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:09 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Volume 573e8239-cb50-4a7f-815d-7f2a870e9e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-573e8239-cb50-4a7f-815d-7f2a870e9e37', 'volume_size': 1} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164" returned: 0 in 0.775s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Created reservations ['8c68d8c1-9295-4563-9bf0-6a4ec8907b3f', '0ce843d4-eeee-4e44-ac72-f74605254f0c', '4798977c-dab4-4765-a1d5-bf674a6d0217', '6150fdcc-c929-4afb-9343-56db3020ee6b'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:09 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 1G Apr 15 22:25:09 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:09 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:09 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:10 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 1G" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:10 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:10 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 Apr 15 22:25:10 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.448s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:10 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:10 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Deleted volume successfully. Apr 15 22:25:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1090b232-807e-4d90-98cc-6692bc2e3c5b tempest-VolumesSnapshotTestJSON-1378274503 None] Lock "cinder-ccda5467-92f5-4c61-a33c-5185b7828244-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:10 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0" returned: 0 in 0.502s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:10 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 is being set with open permissions: ugo+rw Apr 15 22:25:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:10 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 Apr 15 22:25:10 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:11 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0" returned: 0 in 0.446s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:11 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.info Apr 15 22:25:11 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:11 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.info" returned: 0 in 0.496s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:11 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.info is being set with open permissions: ugo+rw Apr 15 22:25:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:11 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.info Apr 15 22:25:11 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:12 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.info" returned: 0 in 0.487s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.255s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.479s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1115662753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573e8239-cb50-4a7f-815d-7f2a870e9e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05b5e3e492d4e978e3230931923724e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:09Z,use_quota=True,user_id='37134ef39d2d4d4bab9760373f3e03f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Creating volume 573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:12 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:12 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-477e9fa4-8a79-42a8-8f5c-a9598ff5cbf5 tempest-VolumesExtendTest-707559151 None] Create snapshot completed successfully Apr 15 22:25:12 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 1073741824 Apr 15 22:25:12 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:12 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 1073741824" returned: 0 in 0.569s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:12 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 Apr 15 22:25:12 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:13 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37" returned: 0 in 0.511s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.133s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9cf97d-eb48-407c-aaf5-9826fb94bdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573e8239-cb50-4a7f-815d-7f2a870e9e37', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01573422-cfb9-49c5-a9a5-34b2b3533a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4b76c2-3e50-475e-a1cd-f221e7e0691f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:13 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Volume volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 (573e8239-cb50-4a7f-815d-7f2a870e9e37): created successfully Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01573422-cfb9-49c5-a9a5-34b2b3533a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Flow 'volume_create_manager' (12f6013c-fab2-49d2-b40a-7f7f119df942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:13 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c531c2ba-b6b2-4116-a896-38edcfe22883 tempest-VolumesCloneTest-924343773 None] Created volume successfully. Apr 15 22:25:13 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 Apr 15 22:25:13 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:13 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164" returned: 0 in 0.604s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 2G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 2G" returned: 0 in 0.087s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.720s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:13 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e2dfc5ed-a28f-4d87-86a3-d4e165bfab76 tempest-VolumesExtendTest-707559151 None] Extend volume completed successfully. Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Flow 'volume_create_manager' (aaa608a2-09ac-4a08-9bad-c4ba1274f6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e96e32-09af-4963-b8c8-3722e4d72364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88e96e32-09af-4963-b8c8-3722e4d72364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-199406304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ea71d32-5304-4719-a4c8-de47600957fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d05b5e3e492d4e978e3230931923724e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=573e8239-cb50-4a7f-815d-7f2a870e9e37,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:14Z,use_quota=True,user_id='37134ef39d2d4d4bab9760373f3e03f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44a3dad-03f8-4d9e-806b-66e71fd31aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44a3dad-03f8-4d9e-806b-66e71fd31aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea4d282-32e2-4df2-b2c2-f60092ae5c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea4d282-32e2-4df2-b2c2-f60092ae5c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2ea71d32-5304-4719-a4c8-de47600957fa', 'volume_name': 'volume-2ea71d32-5304-4719-a4c8-de47600957fa', 'volume_size': 2, 'source_volid': '573e8239-cb50-4a7f-815d-7f2a870e9e37', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edec9f71-e4c4-46b9-8224-7dbb2868e7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edec9f71-e4c4-46b9-8224-7dbb2868e7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7857d8a-0a92-4f73-b164-c2d2f93a8de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Volume 2ea71d32-5304-4719-a4c8-de47600957fa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2ea71d32-5304-4719-a4c8-de47600957fa', 'volume_size': 2, 'source_volid': '573e8239-cb50-4a7f-815d-7f2a870e9e37', 'source_volstatus': 'available'} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:14 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Cloning volume 573e8239-cb50-4a7f-815d-7f2a870e9e37 to volume 2ea71d32-5304-4719-a4c8-de47600957fa Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Creating offline snapshot 18bdf331-2d88-4a3a-bd64-0779e7a607fb of volume 573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[703791d6-54d4-4529-931b-e462e50931da]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Acquiring lock "cinder-f61fc786-4366-46e8-b27f-e1d822d7eeb0-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Lock "cinder-f61fc786-4366-46e8-b27f-e1d822d7eeb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Acquiring lock "cinder-quobyte-c6f2b404-20ed-4929-bd7d-a8eca3273164" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:14 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 Apr 15 22:25:14 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-c6f2b404-20ed-4929-bd7d-a8eca3273164" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Acquiring lock "cinder-quobyte-f61fc786-4366-46e8-b27f-e1d822d7eeb0" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-f61fc786-4366-46e8-b27f-e1d822d7eeb0" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Deleting offline snapshot f61fc786-4366-46e8-b27f-e1d822d7eeb0 of volume c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] snapshot_file for this snap is: volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[142b03bd-ef19-4fc0-9303-b01a3602404a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:14 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 Apr 15 22:25:14 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (a2846b2a-ebf5-487e-80c5-f879e4941754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a3f074-6968-4386-a8ab-4eeb25d66ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a3f074-6968-4386-a8ab-4eeb25d66ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466099597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad9a274-a02e-47a0-9076-3e01079b979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:14Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1f6d0a-0e46-44d3-98b5-5b2e0ba070cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de1f6d0a-0e46-44d3-98b5-5b2e0ba070cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9e150-3a53-4969-82a5-9f4afc771ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d9e150-3a53-4969-82a5-9f4afc771ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad9a274-a02e-47a0-9076-3e01079b979e', 'volume_name': 'volume-fad9a274-a02e-47a0-9076-3e01079b979e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b696b7a-e408-46a0-8835-73932e3eebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b696b7a-e408-46a0-8835-73932e3eebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddd1941-764c-4848-ab22-3a5111a5e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:14 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume fad9a274-a02e-47a0-9076-3e01079b979e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad9a274-a02e-47a0-9076-3e01079b979e', 'volume_size': 1} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:14 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37" returned: 0 in 0.540s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:14 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb 1G Apr 15 22:25:14 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:14 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0" returned: 0 in 0.528s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f2b404-20ed-4929-bd7d-a8eca3273164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b682cb-d748-43ac-9939-794d2b21a04f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:14 devstack sudo[87746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 Apr 15 22:25:14 devstack sudo[87746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:15 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb 1G" returned: 0 in 0.517s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:15 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb Apr 15 22:25:15 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:15 devstack sudo[87746]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:15 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 Apr 15 22:25:15 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:15 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb" returned: 0 in 0.508s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:15 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb is being set with open permissions: ugo+rw Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:15 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb Apr 15 22:25:15 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:15 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0" returned: 0 in 0.592s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:15 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0 Apr 15 22:25:15 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:16 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:16 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.info Apr 15 22:25:16 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:16 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164.f61fc786-4366-46e8-b27f-e1d822d7eeb0" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-f61fc786-4366-46e8-b27f-e1d822d7eeb0" released by "_delete_snapshot" :: held 2.177s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-c6f2b404-20ed-4929-bd7d-a8eca3273164" released by "delete_snapshot" :: held 2.190s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Created reservations ['61037ca5-3419-4179-9c20-5e0a45ccc01e', 'ed9bc5fc-bbf0-4ea0-a301-e95c0e45cfab', '42a1da22-2e65-49f1-99be-241182d68a6c', '89ee08a3-90cd-43bb-a93d-5d4ac563694d'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Delete snapshot completed successfully. Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-95b55a10-e1d8-44bb-b4f6-bbe0593cc966 tempest-VolumesExtendTest-707559151 None] Lock "cinder-f61fc786-4366-46e8-b27f-e1d822d7eeb0-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:16 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.info" returned: 0 in 0.538s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:16 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.info is being set with open permissions: ugo+rw Apr 15 22:25:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:16 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.info Apr 15 22:25:16 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:17 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.info" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Acquiring lock "cinder-quobyte-2ea71d32-5304-4719-a4c8-de47600957fa" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-2ea71d32-5304-4719-a4c8-de47600957fa" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] snapshot: 18bdf331-2d88-4a3a-bd64-0779e7a607fb, volume: 2ea71d32-5304-4719-a4c8-de47600957fa, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a9891-b896-4e90-8938-e685c8c6ff39]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:17 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:17 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:17 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb Apr 15 22:25:17 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Acquiring lock "cinder-c6f2b404-20ed-4929-bd7d-a8eca3273164-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Lock "cinder-c6f2b404-20ed-4929-bd7d-a8eca3273164-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Acquiring lock "cinder-quobyte-c6f2b404-20ed-4929-bd7d-a8eca3273164" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-c6f2b404-20ed-4929-bd7d-a8eca3273164" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6fa9af-1919-4857-9e74-56200b9cd5f1]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:17 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 Apr 15 22:25:17 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:17 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb" returned: 0 in 0.638s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-573e8239-cb50-4a7f-815d-7f2a870e9e37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f6c507-6e1a-4e4b-bd54-72e4a0e24fa2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:18 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.678s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:18 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 Apr 15 22:25:18 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:18 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164" returned: 0 in 0.631s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:18 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164 Apr 15 22:25:18 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:18 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37" returned: 0 in 0.572s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:18 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa Apr 15 22:25:18 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:18 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6f2b404-20ed-4929-bd7d-a8eca3273164" returned: 0 in 0.499s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Lock "cinder-quobyte-c6f2b404-20ed-4929-bd7d-a8eca3273164" released by "delete_volume" :: held 1.162s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Created reservations ['2489af3c-9b52-4e80-bce0-ad9e2fb33e52', '42e5cbb7-3520-458b-a89a-8e9db2c8de3d', 'f1f0b5f9-2fc8-402e-b4a7-48bf42e87052', '5c3557ea-4db1-4c00-96e0-1482097b306a'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:18 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:18 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:19 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.521s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:19 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:19 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Deleted volume successfully. Apr 15 22:25:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-48f9f4b4-6d4d-4c6e-80cf-3e1b0a1aca5e tempest-VolumesExtendTest-707559151 None] Lock "cinder-c6f2b404-20ed-4929-bd7d-a8eca3273164-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Flow 'volume_create_manager' (d3b96f0c-eec0-4d55-bb39-3f0ef360e7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4cbdb9-f0c3-4cb2-a8b9-dd7571005aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd4cbdb9-f0c3-4cb2-a8b9-dd7571005aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2084699069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec7064b-c03c-4bc8-b8a8-2adb979a80e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3dab23779ca47f381f462b277a79ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:20Z,use_quota=True,user_id='ccbd56d797314a5792f53024cde7723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf30d7e-c484-4333-93e3-ed30514d136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bf30d7e-c484-4333-93e3-ed30514d136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf04c53-0372-45ae-86c1-e6560c9c9927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bf04c53-0372-45ae-86c1-e6560c9c9927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec7064b-c03c-4bc8-b8a8-2adb979a80e9', 'volume_name': 'volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814b49fe-a6c5-4ca1-a7d0-f5bf69e2c95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (814b49fe-a6c5-4ca1-a7d0-f5bf69e2c95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c4f5df-d96c-417e-aeed-90ee69957170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:20 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Volume bec7064b-c03c-4bc8-b8a8-2adb979a80e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9', 'volume_size': 1} Apr 15 22:25:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:21 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa" returned: 0 in 2.522s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:21 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b4f64d-e4ea-4811-9122-2f2316ea6416]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:21 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 Apr 15 22:25:21 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:21 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37" returned: 0 in 0.672s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:21 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37, size 1024.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:25:21 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Converted 1024.00 MB image at 405.77 MB/s Apr 15 22:25:21 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa is being set with open permissions: ugo+rw Apr 15 22:25:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:21 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa Apr 15 22:25:21 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:22 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa" returned: 0 in 0.470s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-2ea71d32-5304-4719-a4c8-de47600957fa" released by "_copy_volume_from_snapshot" :: held 4.943s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Acquiring lock "cinder-quobyte-18bdf331-2d88-4a3a-bd64-0779e7a607fb" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-18bdf331-2d88-4a3a-bd64-0779e7a607fb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Deleting offline snapshot 18bdf331-2d88-4a3a-bd64-0779e7a607fb of volume 573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] snapshot_file for this snap is: volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb0a579-afdd-435f-a161-02fc00590534]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (01bbd568-7732-4e40-a3b4-14bc05e44e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffd23c1-36e1-473b-9319-f567dd3df4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffd23c1-36e1-473b-9319-f567dd3df4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1194042301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f8bfbf-f95f-407b-a401-665145056fcd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:22Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a333b4f-c65d-4711-b41b-b3d1ffd2b69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a333b4f-c65d-4711-b41b-b3d1ffd2b69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2d4ef2-695d-47f7-a916-1224fba937ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2d4ef2-695d-47f7-a916-1224fba937ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8f8bfbf-f95f-407b-a401-665145056fcd', 'volume_name': 'volume-e8f8bfbf-f95f-407b-a401-665145056fcd', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a25083c-6419-462e-baf6-01761068cbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a25083c-6419-462e-baf6-01761068cbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2b41cd-8cd3-4683-a79f-8e77617baf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:22 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Volume e8f8bfbf-f95f-407b-a401-665145056fcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8f8bfbf-f95f-407b-a401-665145056fcd', 'volume_size': 1} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:22 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb Apr 15 22:25:22 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:22 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-573e8239-cb50-4a7f-815d-7f2a870e9e37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de506f6-b87f-44c8-9f4c-cf85ecc7d6da]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:22 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 Apr 15 22:25:22 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:23 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37" returned: 0 in 0.481s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:23 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb Apr 15 22:25:23 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:23 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:23 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb Apr 15 22:25:23 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:24 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37.18bdf331-2d88-4a3a-bd64-0779e7a607fb" returned: 0 in 0.416s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-18bdf331-2d88-4a3a-bd64-0779e7a607fb" released by "_delete_snapshot" :: held 1.891s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.056s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.659s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1466099597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad9a274-a02e-47a0-9076-3e01079b979e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:14Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Creating volume fad9a274-a02e-47a0-9076-3e01079b979e {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:24 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7857d8a-0a92-4f73-b164-c2d2f93a8de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ea71d32-5304-4719-a4c8-de47600957fa', 'volume_size': 2, 'source_volid': '573e8239-cb50-4a7f-815d-7f2a870e9e37', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:24 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e 1073741824 Apr 15 22:25:24 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87523b0-1f1e-4e82-ad0b-816e5127f311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:24 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Volume volume-2ea71d32-5304-4719-a4c8-de47600957fa (2ea71d32-5304-4719-a4c8-de47600957fa): created successfully Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87523b0-1f1e-4e82-ad0b-816e5127f311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Flow 'volume_create_manager' (aaa608a2-09ac-4a08-9bad-c4ba1274f6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:24 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-72273216-60f1-4526-9fb7-6c51dfc19a9b tempest-VolumesCloneTest-924343773 None] Created volume successfully. Apr 15 22:25:24 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e 1073741824" returned: 0 in 0.525s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:24 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e Apr 15 22:25:24 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Acquiring lock "cinder-2ea71d32-5304-4719-a4c8-de47600957fa-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Lock "cinder-2ea71d32-5304-4719-a4c8-de47600957fa-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Acquiring lock "cinder-quobyte-2ea71d32-5304-4719-a4c8-de47600957fa" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-2ea71d32-5304-4719-a4c8-de47600957fa" acquired by "delete_volume" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4b77b0-77c9-4e05-b273-6b08d82b6f43]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:24 devstack sudo[87937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa Apr 15 22:25:24 devstack sudo[87937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:25 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e" returned: 0 in 0.425s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.690s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2084699069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec7064b-c03c-4bc8-b8a8-2adb979a80e9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3dab23779ca47f381f462b277a79ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:20Z,use_quota=True,user_id='ccbd56d797314a5792f53024cde7723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Creating volume bec7064b-c03c-4bc8-b8a8-2adb979a80e9 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:25 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ddd1941-764c-4848-ab22-3a5111a5e5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad9a274-a02e-47a0-9076-3e01079b979e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954ac8f7-2241-43c5-896b-bdee405b05a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:25 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 1073741824 Apr 15 22:25:25 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:25 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume volume-fad9a274-a02e-47a0-9076-3e01079b979e (fad9a274-a02e-47a0-9076-3e01079b979e): created successfully Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954ac8f7-2241-43c5-896b-bdee405b05a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (a2846b2a-ebf5-487e-80c5-f879e4941754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:25 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-246d9af7-38a7-4edf-bfe9-85d6c10db5ce tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created volume successfully. Apr 15 22:25:25 devstack sudo[87937]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa" returned: 0 in 0.511s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:25 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa Apr 15 22:25:25 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:25 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 1073741824" returned: 0 in 0.501s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:25 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 Apr 15 22:25:25 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:25 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2ea71d32-5304-4719-a4c8-de47600957fa" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-2ea71d32-5304-4719-a4c8-de47600957fa" released by "delete_volume" :: held 0.998s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Created reservations ['fb05ba45-68ad-4405-8f6a-c55f8c676370', '95a862ff-bf21-47cf-a40e-9798bf73c733', '6a65e659-d36b-4c72-963a-43d8d440e764', '14f4c077-5e67-4f74-a3ec-51a95c2a5b8c'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:25 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:25 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Acquiring lock "cinder-573e8239-cb50-4a7f-815d-7f2a870e9e37-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Lock "cinder-573e8239-cb50-4a7f-815d-7f2a870e9e37-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Acquiring lock "cinder-quobyte-573e8239-cb50-4a7f-815d-7f2a870e9e37" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-573e8239-cb50-4a7f-815d-7f2a870e9e37" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d9a284-07f6-44f5-b9fe-f2850fef2ead]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:26 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 Apr 15 22:25:26 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:26 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9" returned: 0 in 0.499s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.840s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1194042301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8f8bfbf-f95f-407b-a401-665145056fcd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:22Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Creating volume e8f8bfbf-f95f-407b-a401-665145056fcd {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:26 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40c4f5df-d96c-417e-aeed-90ee69957170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ea4e3-b5f9-47fd-b55e-735e8d0a3fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd 1073741824 Apr 15 22:25:26 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:26 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Volume volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 (bec7064b-c03c-4bc8-b8a8-2adb979a80e9): created successfully Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ea4e3-b5f9-47fd-b55e-735e8d0a3fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Flow 'volume_create_manager' (d3b96f0c-eec0-4d55-bb39-3f0ef360e7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:26 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-80eab13c-a1d3-4b07-97cd-8290b72e5067 tempest-VolumesTestJSON-974141822 None] Created volume successfully. Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:26 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (8763c029-3174-4952-a570-3a1c3cecf1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db66ea6-780b-44bb-916e-4b6fbcadd9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.576s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:26 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Deleted volume successfully. Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db66ea6-780b-44bb-916e-4b6fbcadd9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451084458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c088f2e-7c79-4896-9633-0d450f643240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:26Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d87df0b-93e2-4348-aaa9-b5552817fd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d87df0b-93e2-4348-aaa9-b5552817fd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67818dea-3c52-463d-b6e0-c1240ff2b11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67818dea-3c52-463d-b6e0-c1240ff2b11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c088f2e-7c79-4896-9633-0d450f643240', 'volume_name': 'volume-3c088f2e-7c79-4896-9633-0d450f643240', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6897d4c4-1db3-45f0-a9f0-fae0e0df1fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6897d4c4-1db3-45f0-a9f0-fae0e0df1fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfc6e1d-045d-4ef1-862d-d5cc5d47c411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume 3c088f2e-7c79-4896-9633-0d450f643240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c088f2e-7c79-4896-9633-0d450f643240', 'volume_size': 1} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-600ed007-f78c-4e30-81f9-5a4917873db1 tempest-VolumesCloneTest-924343773 None] Lock "cinder-2ea71d32-5304-4719-a4c8-de47600957fa-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (3bac391c-d55f-4af3-a45d-184015d6f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a105a24-d413-4720-89d7-28954fa782f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a105a24-d413-4720-89d7-28954fa782f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1067758768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d9a09-2040-4516-a80d-6d8bd90fbda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cc655f-fdf2-4031-845b-89dc0c716fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97cc655f-fdf2-4031-845b-89dc0c716fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c416bf2-57d2-4492-a66c-0b2054d9469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c416bf2-57d2-4492-a66c-0b2054d9469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925d9a09-2040-4516-a80d-6d8bd90fbda9', 'volume_name': 'volume-925d9a09-2040-4516-a80d-6d8bd90fbda9', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae106ca-1f50-4eaf-b23b-4ec105028166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae106ca-1f50-4eaf-b23b-4ec105028166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbd5aae-071c-4459-839c-b2dff42fbb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume 925d9a09-2040-4516-a80d-6d8bd90fbda9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925d9a09-2040-4516-a80d-6d8bd90fbda9', 'volume_size': 1} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37" returned: 0 in 0.701s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:26 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37 Apr 15 22:25:26 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:26 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (b4189b4a-bed1-4dfd-b215-7943bb20c254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f5e0aa-6b00-450e-9592-e3ccd0161de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd 1073741824" returned: 0 in 0.749s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f5e0aa-6b00-450e-9592-e3ccd0161de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1943979227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a2c729-06c0-4692-b2c5-34270d0e1730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fcaead-ed02-4fbb-956d-1632436813e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fcaead-ed02-4fbb-956d-1632436813e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a676dbd-78c4-4a32-89b5-155dbd8de7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a676dbd-78c4-4a32-89b5-155dbd8de7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a2c729-06c0-4692-b2c5-34270d0e1730', 'volume_name': 'volume-69a2c729-06c0-4692-b2c5-34270d0e1730', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e02493-5b23-4d3b-a673-898cf3c749e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e02493-5b23-4d3b-a673-898cf3c749e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18118717-7814-40fd-a82a-531867ed7eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume 69a2c729-06c0-4692-b2c5-34270d0e1730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a2c729-06c0-4692-b2c5-34270d0e1730', 'volume_size': 1} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:27 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd Apr 15 22:25:27 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Flow 'volume_create_manager' (5b2b7f4a-4d0c-4a80-acd1-745c02598a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e41bd98-e491-48de-80c6-802b124620d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e41bd98-e491-48de-80c6-802b124620d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1701291616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0b613e-7b95-4353-a458-aa6c816e9dfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3dab23779ca47f381f462b277a79ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='ccbd56d797314a5792f53024cde7723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29c894f-4ed8-4d1e-bc14-537eb72951a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d29c894f-4ed8-4d1e-bc14-537eb72951a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759357cb-7f7b-4178-aaf7-ac99860818fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (759357cb-7f7b-4178-aaf7-ac99860818fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0b613e-7b95-4353-a458-aa6c816e9dfb', 'volume_name': 'volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae183e5-2c09-441d-8a2e-6623675fe4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae183e5-2c09-441d-8a2e-6623675fe4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a223b8b-705f-4002-86f2-185274484183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Volume 0b0b613e-7b95-4353-a458-aa6c816e9dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb', 'volume_size': 1} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (eae19c32-c698-4830-83ed-7d910f8a33b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c995b734-6a14-4c69-b3bc-f7f6e3ea36e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c995b734-6a14-4c69-b3bc-f7f6e3ea36e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278694781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b947468b-f644-4b4d-b1df-5e2a2a86eaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca31c24-ea57-4532-8abf-a064e4df88e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca31c24-ea57-4532-8abf-a064e4df88e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f9c64f-1f17-43ba-b79c-6ab4d89530ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95f9c64f-1f17-43ba-b79c-6ab4d89530ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b947468b-f644-4b4d-b1df-5e2a2a86eaf1', 'volume_name': 'volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cb11b5-755a-41e4-90e4-74d0959418fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40cb11b5-755a-41e4-90e4-74d0959418fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b213545-29c7-4028-9da6-5cd75ef94824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume b947468b-f644-4b4d-b1df-5e2a2a86eaf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1', 'volume_size': 1} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:27 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-573e8239-cb50-4a7f-815d-7f2a870e9e37" returned: 0 in 0.582s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Lock "cinder-quobyte-573e8239-cb50-4a7f-815d-7f2a870e9e37" released by "delete_volume" :: held 1.316s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (7e7d604a-d2a7-44f2-8464-1aea3ab4c454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d755b4c-7d0c-4913-9a6a-4282f53a96e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d755b4c-7d0c-4913-9a6a-4282f53a96e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024682130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a53069f-0848-4552-831f-b666fb7d216d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe51083-3333-45d9-b779-014e46bf85fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe51083-3333-45d9-b779-014e46bf85fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc1c2bb-c733-4c8f-98c5-666ff42972c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc1c2bb-c733-4c8f-98c5-666ff42972c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a53069f-0848-4552-831f-b666fb7d216d', 'volume_name': 'volume-3a53069f-0848-4552-831f-b666fb7d216d', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68884f71-00ac-42bb-b820-931b951369d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68884f71-00ac-42bb-b820-931b951369d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c79b93-d746-4cf8-9f17-ee4e2a635c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume 3a53069f-0848-4552-831f-b666fb7d216d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a53069f-0848-4552-831f-b666fb7d216d', 'volume_size': 1} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Created reservations ['45f65f4e-eb31-4f7d-840f-591da35d2589', '41303d52-83f1-4bb6-92dd-2ee769d8c53d', '7c92ca31-f167-4072-b303-a905a56e02a7', '9a78e0b4-b7a6-432e-a81b-d2f7f250c6cb'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:27 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:27 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:27 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd" returned: 0 in 0.538s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.996s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1451084458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c088f2e-7c79-4896-9633-0d450f643240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:26Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Creating volume 3c088f2e-7c79-4896-9633-0d450f643240 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e2b41cd-8cd3-4683-a79f-8e77617baf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8f8bfbf-f95f-407b-a401-665145056fcd', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d119efc8-447b-4a59-b75b-6654c4fce2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:27 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 1073741824 Apr 15 22:25:27 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Volume volume-e8f8bfbf-f95f-407b-a401-665145056fcd (e8f8bfbf-f95f-407b-a401-665145056fcd): created successfully Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d119efc8-447b-4a59-b75b-6654c4fce2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (01bbd568-7732-4e40-a3b4-14bc05e44e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2eaee211-16c6-4c3e-bf8b-31191c7c148b tempest-VolumesGetTest-1533517202 None] Created volume successfully. Apr 15 22:25:27 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.422s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:27 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Deleted volume successfully. Apr 15 22:25:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ddec5238-345e-4948-beb9-7e6cf2068e5b tempest-VolumesCloneTest-924343773 None] Lock "cinder-573e8239-cb50-4a7f-815d-7f2a870e9e37-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:28 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 1073741824" returned: 0 in 0.513s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:28 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 Apr 15 22:25:28 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:28 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240" returned: 0 in 0.517s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.861s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1067758768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925d9a09-2040-4516-a80d-6d8bd90fbda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Creating volume 925d9a09-2040-4516-a80d-6d8bd90fbda9 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:28 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bfc6e1d-045d-4ef1-862d-d5cc5d47c411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c088f2e-7c79-4896-9633-0d450f643240', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:28 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 1073741824 Apr 15 22:25:28 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9b4a83-484c-4ae3-b1a9-e9cdb6fbc611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:28 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume volume-3c088f2e-7c79-4896-9633-0d450f643240 (3c088f2e-7c79-4896-9633-0d450f643240): created successfully Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9b4a83-484c-4ae3-b1a9-e9cdb6fbc611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (8763c029-3174-4952-a570-3a1c3cecf1dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:28 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f1b5307b-4eb4-4b07-9e36-8efeb058ac38 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created volume successfully. Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (23c520f8-b5f1-4921-8703-578dfcc04407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bf101e-3629-4f7e-a7c4-9f2f9e5fb987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8bf101e-3629-4f7e-a7c4-9f2f9e5fb987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-540194011',display_name='tempest-VolumesGetTest-Volume-56344485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03cc487-352b-4c13-b068-2d98ad74c716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:29Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa8576-db74-407c-9599-94a381099e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa8576-db74-407c-9599-94a381099e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5928ef-2fb4-4add-8101-442cb16b137f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5928ef-2fb4-4add-8101-442cb16b137f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e03cc487-352b-4c13-b068-2d98ad74c716', 'volume_name': 'volume-e03cc487-352b-4c13-b068-2d98ad74c716', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec70b7b-7581-441a-a665-f13ebb8e05d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec70b7b-7581-441a-a665-f13ebb8e05d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5689c4c-c3ab-47da-b7ae-ae420c3414e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:29 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Volume e03cc487-352b-4c13-b068-2d98ad74c716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e03cc487-352b-4c13-b068-2d98ad74c716', 'volume_size': 1} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:29 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 1073741824" returned: 0 in 0.654s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:29 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 Apr 15 22:25:29 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:29 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] <== create_volume: return (1161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.788s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1943979227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69a2c729-06c0-4692-b2c5-34270d0e1730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Creating volume 69a2c729-06c0-4692-b2c5-34270d0e1730 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:29 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:29 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 1073741824 Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbd5aae-071c-4459-839c-b2dff42fbb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925d9a09-2040-4516-a80d-6d8bd90fbda9', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:29 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268b1972-cfa4-4949-9a0c-eca0b8ba42c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:29 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 (925d9a09-2040-4516-a80d-6d8bd90fbda9): created successfully Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (268b1972-cfa4-4949-9a0c-eca0b8ba42c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (3bac391c-d55f-4af3-a45d-184015d6f87a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:29 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-bd8baaa6-8f82-4618-aefe-01d0423fb417 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created volume successfully. Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Flow 'volume_create_manager' (a10e93b7-e960-49b6-bad1-8b8e675f07c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca2af4c-3794-4d8a-bdc3-c090b4b87d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca2af4c-3794-4d8a-bdc3-c090b4b87d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-811173576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8795bb-88ba-4b74-b7cd-098e02907020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f7381a2e3c4e129db5562faea70107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:30Z,use_quota=True,user_id='023ed18333e44dfca9425f6bb40740c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b2d4e1-7fdc-4025-bd48-c05609065e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b2d4e1-7fdc-4025-bd48-c05609065e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2680aea0-0fb7-473c-9ddb-b25e2791973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2680aea0-0fb7-473c-9ddb-b25e2791973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8795bb-88ba-4b74-b7cd-098e02907020', 'volume_name': 'volume-1d8795bb-88ba-4b74-b7cd-098e02907020', 'volume_size': 2}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69a8fdb-4ed5-4842-88f1-30bb7e77f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69a8fdb-4ed5-4842-88f1-30bb7e77f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657207bb-8ede-4bbd-b1cf-7b86d44343e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:30 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Volume 1d8795bb-88ba-4b74-b7cd-098e02907020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8795bb-88ba-4b74-b7cd-098e02907020', 'volume_size': 2} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:30 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 1073741824" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:30 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 Apr 15 22:25:30 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:30 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730" returned: 0 in 0.413s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.601s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1701291616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0b613e-7b95-4353-a458-aa6c816e9dfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3dab23779ca47f381f462b277a79ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='ccbd56d797314a5792f53024cde7723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Creating volume 0b0b613e-7b95-4353-a458-aa6c816e9dfb {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:30 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:30 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb 1073741824 Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18118717-7814-40fd-a82a-531867ed7eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a2c729-06c0-4692-b2c5-34270d0e1730', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:30 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f70b8a-c4fe-4967-a36f-253486351b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:30 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume volume-69a2c729-06c0-4692-b2c5-34270d0e1730 (69a2c729-06c0-4692-b2c5-34270d0e1730): created successfully Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6f70b8a-c4fe-4967-a36f-253486351b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (b4189b4a-bed1-4dfd-b215-7943bb20c254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:30 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ed55b16c-92a1-4720-8143-6363d4a0a237 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created volume successfully. Apr 15 22:25:31 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb 1073741824" returned: 0 in 0.512s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:31 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb Apr 15 22:25:31 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:31 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb" returned: 0 in 0.415s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.454s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1278694781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b947468b-f644-4b4d-b1df-5e2a2a86eaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Creating volume b947468b-f644-4b4d-b1df-5e2a2a86eaf1 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:31 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a223b8b-705f-4002-86f2-185274484183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:31 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 1073741824 Apr 15 22:25:31 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f96169-9c4e-485f-b9d4-d11f45f0a3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:31 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Volume volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb (0b0b613e-7b95-4353-a458-aa6c816e9dfb): created successfully Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08f96169-9c4e-485f-b9d4-d11f45f0a3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Flow 'volume_create_manager' (5b2b7f4a-4d0c-4a80-acd1-745c02598a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:31 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-74838b12-159f-46ca-bb8e-2b75ad51043b tempest-VolumesTestJSON-974141822 None] Created volume successfully. Apr 15 22:25:32 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 1073741824" returned: 0 in 0.507s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:32 devstack sudo[88014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 Apr 15 22:25:32 devstack sudo[88014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Flow 'volume_create_manager' (b182b55c-9361-48db-a182-cda9498cba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b184ff48-aa39-4a44-8262-84d42ebece1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b184ff48-aa39-4a44-8262-84d42ebece1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1750763841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095e1b4f-6961-4584-ad97-35c5cc7aca3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3dab23779ca47f381f462b277a79ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:33Z,use_quota=True,user_id='ccbd56d797314a5792f53024cde7723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08197222-0014-4e17-997c-e1e1076bc2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08197222-0014-4e17-997c-e1e1076bc2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04fd119-63c5-4727-a59f-96d336c486ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e04fd119-63c5-4727-a59f-96d336c486ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095e1b4f-6961-4584-ad97-35c5cc7aca3a', 'volume_name': 'volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6610c6ba-a2b4-4c00-b30d-a1f3d0ec0443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6610c6ba-a2b4-4c00-b30d-a1f3d0ec0443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87e73ae-985b-43cf-a77d-aa844b4ee060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:32 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Volume 095e1b4f-6961-4584-ad97-35c5cc7aca3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a', 'volume_size': 1} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:32 devstack sudo[88014]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.291s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024682130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a53069f-0848-4552-831f-b666fb7d216d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84da14c2206147fd954df73acd08909a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:27Z,use_quota=True,user_id='c7e71dda1d504d449a52f2bcfce4a46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Creating volume 3a53069f-0848-4552-831f-b666fb7d216d {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:32 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b213545-29c7-4028-9da6-5cd75ef94824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e89e03-99db-4aa0-8526-6dacf567903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:32 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d 1073741824 Apr 15 22:25:32 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:32 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 (b947468b-f644-4b4d-b1df-5e2a2a86eaf1): created successfully Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e89e03-99db-4aa0-8526-6dacf567903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (eae19c32-c698-4830-83ed-7d910f8a33b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:32 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-7bf4ff47-c64d-458b-ae51-3e4d725dcec4 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created volume successfully. Apr 15 22:25:33 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d 1073741824" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:33 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d Apr 15 22:25:33 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:33 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d" returned: 0 in 0.421s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.511s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-540194011',display_name='tempest-VolumesGetTest-Volume-56344485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e03cc487-352b-4c13-b068-2d98ad74c716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:29Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Creating volume e03cc487-352b-4c13-b068-2d98ad74c716 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:33 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:33 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 1073741824 Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c79b93-d746-4cf8-9f17-ee4e2a635c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a53069f-0848-4552-831f-b666fb7d216d', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:33 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0753f61-5ae5-4758-a362-ffaa89c4217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:33 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Volume volume-3a53069f-0848-4552-831f-b666fb7d216d (3a53069f-0848-4552-831f-b666fb7d216d): created successfully Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0753f61-5ae5-4758-a362-ffaa89c4217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Flow 'volume_create_manager' (7e7d604a-d2a7-44f2-8464-1aea3ab4c454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-169ea9a3-2071-41d2-b4c9-47564bcb7f1d tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created volume successfully. Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-3a53069f-0848-4552-831f-b666fb7d216d-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-3a53069f-0848-4552-831f-b666fb7d216d-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-quobyte-3a53069f-0848-4552-831f-b666fb7d216d" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-3a53069f-0848-4552-831f-b666fb7d216d" acquired by "delete_volume" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe478c0-52a4-4462-9cae-c4e33c2f2dc2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:34 devstack sudo[88027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d Apr 15 22:25:34 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:34 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 1073741824" returned: 0 in 0.521s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:34 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 Apr 15 22:25:34 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:34 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d" returned: 0 in 0.512s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:34 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d Apr 15 22:25:34 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:34 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716" returned: 0 in 0.443s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.404s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-811173576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8795bb-88ba-4b74-b7cd-098e02907020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f7381a2e3c4e129db5562faea70107',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:30Z,use_quota=True,user_id='023ed18333e44dfca9425f6bb40740c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Creating volume 1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:34 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 2147483648 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5689c4c-c3ab-47da-b7ae-ae420c3414e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e03cc487-352b-4c13-b068-2d98ad74c716', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:34 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 2147483648 Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753a0e14-9387-428f-8cd3-ef2c326093e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:34 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:34 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Volume volume-e03cc487-352b-4c13-b068-2d98ad74c716 (e03cc487-352b-4c13-b068-2d98ad74c716): created successfully Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753a0e14-9387-428f-8cd3-ef2c326093e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (23c520f8-b5f1-4921-8703-578dfcc04407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:34 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-87866027-0c90-4bda-b930-5a28924b74cd tempest-VolumesGetTest-1533517202 None] Created volume successfully. Apr 15 22:25:34 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a53069f-0848-4552-831f-b666fb7d216d" returned: 0 in 0.417s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-3a53069f-0848-4552-831f-b666fb7d216d" released by "delete_volume" :: held 0.961s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created reservations ['a5798707-5f35-4f52-b85d-c0245ebb2656', '8f7db0cf-d981-4c17-9f69-d217bf399084', '7c709309-55ed-4200-9c51-5af5a1470e82', '2d94e1e1-cd5f-49c1-995d-d28d85fae0b2'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:35 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:35 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-b947468b-f644-4b4d-b1df-5e2a2a86eaf1-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-b947468b-f644-4b4d-b1df-5e2a2a86eaf1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-quobyte-b947468b-f644-4b4d-b1df-5e2a2a86eaf1" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-b947468b-f644-4b4d-b1df-5e2a2a86eaf1" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8578d3a9-e06b-4f67-a8fc-bf57733cf1d2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:35 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 Apr 15 22:25:35 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:35 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 2147483648" returned: 0 in 0.581s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:35 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 Apr 15 22:25:35 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:35 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.468s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:35 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Deleted volume successfully. Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-637a4b80-b8de-4408-91e9-240abb9df5ed tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-3a53069f-0848-4552-831f-b666fb7d216d-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-e03cc487-352b-4c13-b068-2d98ad74c716-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Lock "cinder-e03cc487-352b-4c13-b068-2d98ad74c716-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-e03cc487-352b-4c13-b068-2d98ad74c716" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-e03cc487-352b-4c13-b068-2d98ad74c716" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:35 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1" returned: 0 in 0.527s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[144572bc-03d1-43a0-842d-733b5028106d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:35 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1 Apr 15 22:25:35 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:35 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 Apr 15 22:25:35 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:35 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.090s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1750763841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095e1b4f-6961-4584-ad97-35c5cc7aca3a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e3dab23779ca47f381f462b277a79ffc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:33Z,use_quota=True,user_id='ccbd56d797314a5792f53024cde7723b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Creating volume 095e1b4f-6961-4584-ad97-35c5cc7aca3a {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:35 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657207bb-8ede-4bbd-b1cf-7b86d44343e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8795bb-88ba-4b74-b7cd-098e02907020', 'volume_size': 2}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78f954f-6ae1-4e2c-8951-61ac54c12e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:35 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a 1073741824 Apr 15 22:25:35 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:35 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Volume volume-1d8795bb-88ba-4b74-b7cd-098e02907020 (1d8795bb-88ba-4b74-b7cd-098e02907020): created successfully Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78f954f-6ae1-4e2c-8951-61ac54c12e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:35 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Flow 'volume_create_manager' (a10e93b7-e960-49b6-bad1-8b8e675f07c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:35 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-33a5c00d-93c0-408d-b102-8cb87f320448 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Created volume successfully. Apr 15 22:25:36 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b947468b-f644-4b4d-b1df-5e2a2a86eaf1" returned: 0 in 0.426s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-b947468b-f644-4b4d-b1df-5e2a2a86eaf1" released by "delete_volume" :: held 0.978s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created reservations ['64c1f3ff-5808-43f9-8657-b38f5d2d6280', '4ff96e66-d73d-44c9-9bf2-7d60d58f3c63', '2216eeef-0e36-4079-99f8-526625a2002f', '80b3ee78-b469-493b-8679-f7875041e9ef'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=200,cinder:INSERT=70,cinder:UPDATE=251,cinder:DELETE=22 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=239,cinder:DELETE=22,cinder:SELECT=159,cinder:INSERT=57 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:36 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716" returned: 0 in 0.530s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:36 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:36 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:36 devstack sudo[88071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716 Apr 15 22:25:36 devstack sudo[88071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-69a2c729-06c0-4692-b2c5-34270d0e1730-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-69a2c729-06c0-4692-b2c5-34270d0e1730-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-quobyte-69a2c729-06c0-4692-b2c5-34270d0e1730" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-69a2c729-06c0-4692-b2c5-34270d0e1730" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b15951c-a252-43bb-abd4-f39046ce391b]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:36 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a 1073741824" returned: 0 in 0.553s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:36 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a Apr 15 22:25:36 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:36 devstack sudo[88074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 Apr 15 22:25:36 devstack sudo[88074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:36 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.480s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:36 devstack sudo[88071]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:36 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Deleted volume successfully. Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e03cc487-352b-4c13-b068-2d98ad74c716" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-e03cc487-352b-4c13-b068-2d98ad74c716" released by "delete_volume" :: held 1.056s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6bcfa4bd-9ae9-48e5-a62a-127b15e187fd tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-b947468b-f644-4b4d-b1df-5e2a2a86eaf1-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Created reservations ['3f95fa08-b0ec-42f2-b596-09e677b4af52', '6845a264-1add-4719-b530-198dca26b972', '59442539-45d2-4759-a8d2-07ce0fe3387e', '0a317a06-018c-4bf7-8251-142a800208fd'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:36 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:36 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:36 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a" returned: 0 in 0.565s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.090s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:36 devstack sudo[88074]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Creating offline snapshot 08a132b6-c548-4c87-aa40-649257d7f8b5 of volume 1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87e73ae-985b-43cf-a77d-aa844b4ee060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c31f2d6-5e68-43ee-9726-72ae179ea5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5a1004-85bc-442d-b550-1cd590afebeb]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730" returned: 0 in 0.649s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:36 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Volume volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a (095e1b4f-6961-4584-ad97-35c5cc7aca3a): created successfully Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c31f2d6-5e68-43ee-9726-72ae179ea5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:36 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730 Apr 15 22:25:36 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Flow 'volume_create_manager' (b182b55c-9361-48db-a182-cda9498cba4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:36 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-89b42dbf-7897-4264-9b9b-d7787f64abfe tempest-VolumesTestJSON-974141822 None] Created volume successfully. Apr 15 22:25:37 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 Apr 15 22:25:37 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:37 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.472s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Deleted volume successfully. Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4fadbc55-ecb4-4449-85cc-98cc1f9226d2 tempest-VolumesGetTest-1533517202 None] Lock "cinder-e03cc487-352b-4c13-b068-2d98ad74c716-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:37 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-69a2c729-06c0-4692-b2c5-34270d0e1730" returned: 0 in 0.417s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-69a2c729-06c0-4692-b2c5-34270d0e1730" released by "delete_volume" :: held 1.096s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created reservations ['92dfbe4f-2d43-4fb6-bae3-3d96cdaca6c4', '842aaadf-0f1e-4342-ac91-adce7ee74b3b', '6980860d-85d7-41b6-91f2-f667cd3ee8ab', '5e1a4b99-7c41-4a68-a83c-371d8d384599'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:37 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020" returned: 0 in 0.529s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 2G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:37 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:37 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:37 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 2G Apr 15 22:25:37 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-e8f8bfbf-f95f-407b-a401-665145056fcd-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Lock "cinder-e8f8bfbf-f95f-407b-a401-665145056fcd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-e8f8bfbf-f95f-407b-a401-665145056fcd" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-e8f8bfbf-f95f-407b-a401-665145056fcd" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:37 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.432s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Deleted volume successfully. Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb0d9a-6ae4-46f2-81dd-68a25068ac25]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-7cada5a5-e2be-4f74-adb1-64a979e6c9b9 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-69a2c729-06c0-4692-b2c5-34270d0e1730-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:37 devstack sudo[88105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd Apr 15 22:25:37 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:38 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 2G" returned: 0 in 0.570s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8795bb-88ba-4b74-b7cd-098e02907020 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:38 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8795bb-88ba-4b74-b7cd-098e02907020 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 Apr 15 22:25:38 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-925d9a09-2040-4516-a80d-6d8bd90fbda9-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-925d9a09-2040-4516-a80d-6d8bd90fbda9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-quobyte-925d9a09-2040-4516-a80d-6d8bd90fbda9" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-925d9a09-2040-4516-a80d-6d8bd90fbda9" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:38 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd" returned: 0 in 0.604s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89cf26b-1fd4-4ffd-a248-3da08d10396f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:38 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd Apr 15 22:25:38 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:38 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 Apr 15 22:25:38 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Acquiring lock "cinder-095e1b4f-6961-4584-ad97-35c5cc7aca3a-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:38 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Lock "cinder-095e1b4f-6961-4584-ad97-35c5cc7aca3a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d8795bb-88ba-4b74-b7cd-098e02907020 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5" returned: 0 in 0.587s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:38 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 is being set with open permissions: ugo+rw Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:38 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 Apr 15 22:25:38 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Acquiring lock "cinder-quobyte-095e1b4f-6961-4584-ad97-35c5cc7aca3a" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Lock "cinder-quobyte-095e1b4f-6961-4584-ad97-35c5cc7aca3a" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b6fe23-69e4-4a90-bc0f-3cbc9a24c3ca]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:38 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a Apr 15 22:25:38 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:38 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e8f8bfbf-f95f-407b-a401-665145056fcd" returned: 0 in 0.471s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-e8f8bfbf-f95f-407b-a401-665145056fcd" released by "delete_volume" :: held 1.109s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Created reservations ['f64783c6-8cd9-4235-ae31-25a33cd741b3', '21165fcd-8863-4ea6-959f-91416f647f15', '59b74ac6-7278-4f5a-a9a8-203ff916f95c', '66e2d3ab-a9e2-4e4e-9815-02a27aedd3b4'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:39 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9" returned: 0 in 0.552s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:39 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:39 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:39 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9 Apr 15 22:25:39 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:39 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5" returned: 0 in 0.495s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:39 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.info Apr 15 22:25:39 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:39 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a" returned: 0 in 0.520s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:39 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a Apr 15 22:25:39 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:39 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-925d9a09-2040-4516-a80d-6d8bd90fbda9" returned: 0 in 0.427s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-925d9a09-2040-4516-a80d-6d8bd90fbda9" released by "delete_volume" :: held 1.045s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:39 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.474s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Deleted volume successfully. Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-4b5ebe7e-ff5f-4d4a-a402-d52fee9be372 tempest-VolumesGetTest-1533517202 None] Lock "cinder-e8f8bfbf-f95f-407b-a401-665145056fcd-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created reservations ['59290561-3a39-40f4-9567-c96edd5eaa6d', '9ddaecda-e59e-408d-96d3-2ff73bb482b1', 'b2d1c54f-1b53-441a-9245-ad6e8288edcc', 'e74bdfc6-8d90-4de5-a8dd-07e331cee97c'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:39 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.info" returned: 0 in 0.474s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:39 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.info is being set with open permissions: ugo+rw Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:39 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:39 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:39 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.info Apr 15 22:25:39 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:39 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-095e1b4f-6961-4584-ad97-35c5cc7aca3a" returned: 0 in 0.461s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Lock "cinder-quobyte-095e1b4f-6961-4584-ad97-35c5cc7aca3a" released by "delete_volume" :: held 1.007s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Created reservations ['c7d17cd0-8ccd-4c73-9022-790d53059f25', 'efd2e529-c7ab-4b9a-84bd-effdb7eed421', 'bd2c08c4-a6af-48bd-8b60-70d275b65637', 'b354be06-37f5-4a67-9f2a-ab320dabfd87'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:39 devstack sudo[88147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:39 devstack sudo[88147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:40 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.427s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Deleted volume successfully. Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c994a736-036b-4942-809f-1ac4456f1da0 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-925d9a09-2040-4516-a80d-6d8bd90fbda9-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:40 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.info" returned: 0 in 0.454s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.188s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4ec5fdec-c55d-4738-8741-322e4b978eb0 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Create snapshot completed successfully Apr 15 22:25:40 devstack sudo[88147]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.451s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Deleted volume successfully. Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ecce1dfe-e4d1-4b15-aaa5-c6a1d745d13c tempest-VolumesTestJSON-974141822 None] Lock "cinder-095e1b4f-6961-4584-ad97-35c5cc7aca3a-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (c17c06e5-55de-4a2c-91b7-4afba8d7a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0850d862-b208-40a7-9653-51bb6a6b6452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0850d862-b208-40a7-9653-51bb6a6b6452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650178953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69e320b-7fd8-4dc1-9b6f-88a62047e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:40Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f26aee-595e-40b5-a38c-202b973fc130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f26aee-595e-40b5-a38c-202b973fc130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c9b528-a08c-4de0-8b61-2116229b46df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c9b528-a08c-4de0-8b61-2116229b46df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69e320b-7fd8-4dc1-9b6f-88a62047e2a2', 'volume_name': 'volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85beb9c4-6ddf-41c9-b90a-2354b307c1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85beb9c4-6ddf-41c9-b90a-2354b307c1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300ad351-f55d-4c36-85df-a072fd203438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Volume f69e320b-7fd8-4dc1-9b6f-88a62047e2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2', 'volume_size': 1} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650178953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69e320b-7fd8-4dc1-9b6f-88a62047e2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:40Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Creating volume f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:40 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:40 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 1073741824 Apr 15 22:25:40 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-3c088f2e-7c79-4896-9633-0d450f643240-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-3c088f2e-7c79-4896-9633-0d450f643240-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-quobyte-3c088f2e-7c79-4896-9633-0d450f643240" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-3c088f2e-7c79-4896-9633-0d450f643240" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27489d2-417c-485f-8475-41b82206f378]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:40 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 Apr 15 22:25:40 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Acquiring lock "cinder-0b0b613e-7b95-4353-a458-aa6c816e9dfb-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Lock "cinder-0b0b613e-7b95-4353-a458-aa6c816e9dfb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Acquiring lock "cinder-quobyte-0b0b613e-7b95-4353-a458-aa6c816e9dfb" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Lock "cinder-quobyte-0b0b613e-7b95-4353-a458-aa6c816e9dfb" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e041be-0077-4645-b979-6c7ec8a3348f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:40 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 1073741824" returned: 0 in 0.564s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:40 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 Apr 15 22:25:40 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:40 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb Apr 15 22:25:40 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "cinder-08a132b6-c548-4c87-aa40-649257d7f8b5-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-08a132b6-c548-4c87-aa40-649257d7f8b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "cinder-quobyte-1d8795bb-88ba-4b74-b7cd-098e02907020" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-quobyte-1d8795bb-88ba-4b74-b7cd-098e02907020" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "cinder-quobyte-08a132b6-c548-4c87-aa40-649257d7f8b5" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-quobyte-08a132b6-c548-4c87-aa40-649257d7f8b5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Deleting offline snapshot 08a132b6-c548-4c87-aa40-649257d7f8b5 of volume 1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] snapshot_file for this snap is: volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa32bbd-c1dc-4c9c-ad8e-ef5deb58b690]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:41 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 Apr 15 22:25:41 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:41 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:41 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240 Apr 15 22:25:41 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:41 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (300ad351-f55d-4c36-85df-a072fd203438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13022b44-c7aa-4c31-8e2e-08f94051c538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Volume volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 (f69e320b-7fd8-4dc1-9b6f-88a62047e2a2): created successfully Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13022b44-c7aa-4c31-8e2e-08f94051c538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (c17c06e5-55de-4a2c-91b7-4afba8d7a561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:41 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb" returned: 0 in 0.555s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3d0e810c-ff22-4ddf-a6c0-104e510721df tempest-VolumesGetTest-1533517202 None] Created volume successfully. Apr 15 22:25:41 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb Apr 15 22:25:41 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:41 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5" returned: 0 in 0.502s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d8795bb-88ba-4b74-b7cd-098e02907020(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2447bd15-c3d2-4aed-8c38-575ab6d0309a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:41 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 Apr 15 22:25:41 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:41 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3c088f2e-7c79-4896-9633-0d450f643240" returned: 0 in 0.449s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-3c088f2e-7c79-4896-9633-0d450f643240" released by "delete_volume" :: held 1.015s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created reservations ['dc65f1ad-5b91-43f8-bfbd-ae27bb347613', '67f6e112-8a88-411a-b2b0-687dbbaa2631', 'abde6bd0-b0df-4aef-8e61-95ca0b7d2067', '252a725e-6d16-4fd8-a908-582cae93bf2b'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:41 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:41 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:41 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0b0b613e-7b95-4353-a458-aa6c816e9dfb" returned: 0 in 0.448s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Lock "cinder-quobyte-0b0b613e-7b95-4353-a458-aa6c816e9dfb" released by "delete_volume" :: held 1.023s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Created reservations ['26a8f3a3-6dd8-4039-9a7a-fb49afe3280a', '947200af-2053-43c1-af68-d913c788dd58', '6856b6fb-e4c9-48ba-b31f-3f8195170378', 'b086dde2-db9a-45e3-ac13-b8b9dfe5492e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:42 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:42 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:42 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020" returned: 0 in 0.526s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:42 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 Apr 15 22:25:42 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:42 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.428s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Deleted volume successfully. Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d553ec78-8a54-4385-b935-f02feb92c92c tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-3c088f2e-7c79-4896-9633-0d450f643240-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:42 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.432s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Deleted volume successfully. Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00797121-c54b-492b-a0ad-3423504a011b tempest-VolumesTestJSON-974141822 None] Lock "cinder-0b0b613e-7b95-4353-a458-aa6c816e9dfb-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:42 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5" returned: 0 in 0.481s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:42 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5 Apr 15 22:25:42 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (a8ae94e1-02a5-4630-b75f-7737f49529d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9ed257-a939-4113-8962-4b62f834d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a9ed257-a939-4113-8962-4b62f834d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1011992152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df4f05c0-a691-4a80-ad5c-af53a79a59a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f69e320b-7fd8-4dc1-9b6f-88a62047e2a2,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:43Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aa158c-6361-4ea6-82d1-82ae20233c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7aa158c-6361-4ea6-82d1-82ae20233c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9717cfe-6753-441b-b8e4-9d2d7909456e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-fad9a274-a02e-47a0-9076-3e01079b979e-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9717cfe-6753-441b-b8e4-9d2d7909456e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'df4f05c0-a691-4a80-ad5c-af53a79a59a1', 'volume_name': 'volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1', 'volume_size': 1, 'source_volid': 'f69e320b-7fd8-4dc1-9b6f-88a62047e2a2', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3970020-1b66-41e1-8c81-24edb32660d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3970020-1b66-41e1-8c81-24edb32660d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e422779-f130-46db-8423-1266d97a1230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:42 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Volume df4f05c0-a691-4a80-ad5c-af53a79a59a1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1', 'volume_size': 1, 'source_volid': 'f69e320b-7fd8-4dc1-9b6f-88a62047e2a2', 'source_volstatus': 'available'} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-fad9a274-a02e-47a0-9076-3e01079b979e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:42 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Cloning volume f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 to volume df4f05c0-a691-4a80-ad5c-af53a79a59a1 Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Creating offline snapshot b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc of volume f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e612ecf-cc31-4e90-a914-ba37cf1f93d1]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "cinder-quobyte-fad9a274-a02e-47a0-9076-3e01079b979e" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-fad9a274-a02e-47a0-9076-3e01079b979e" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf31b2-a10a-4286-9cb0-26718c209341]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:42 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 Apr 15 22:25:42 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:42 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e Apr 15 22:25:42 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Acquiring lock "cinder-bec7064b-c03c-4bc8-b8a8-2adb979a80e9-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Lock "cinder-bec7064b-c03c-4bc8-b8a8-2adb979a80e9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Acquiring lock "cinder-quobyte-bec7064b-c03c-4bc8-b8a8-2adb979a80e9" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Lock "cinder-quobyte-bec7064b-c03c-4bc8-b8a8-2adb979a80e9" acquired by "delete_volume" :: waited 0.018s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e302d25f-39ad-4a5d-836b-0c581c602a29]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:43 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020.08a132b6-c548-4c87-aa40-649257d7f8b5" returned: 0 in 0.579s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-quobyte-08a132b6-c548-4c87-aa40-649257d7f8b5" released by "_delete_snapshot" :: held 2.151s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-quobyte-1d8795bb-88ba-4b74-b7cd-098e02907020" released by "delete_snapshot" :: held 2.164s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:43 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 Apr 15 22:25:43 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Created reservations ['22f010f7-dad8-4f15-a28b-22c10574e574', '3b62dbc5-68a4-46c3-8545-d661d0b9192b', 'e2ba8e5c-6b24-4d4d-9ab9-b50c53520d70', '9fcef25a-0873-4f08-86ca-ed3e33aa5912'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:43 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Delete snapshot completed successfully. Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15850ec1-2803-4067-8d28-7d8105af3287 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-08a132b6-c548-4c87-aa40-649257d7f8b5-delete_snapshot" released by "delete_snapshot" :: held 2.263s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:43 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e" returned: 0 in 0.500s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:43 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" returned: 0 in 0.550s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:43 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e Apr 15 22:25:43 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:43 devstack sudo[88215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc 1G Apr 15 22:25:43 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:43 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9" returned: 0 in 0.525s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:43 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9 Apr 15 22:25:43 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:43 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fad9a274-a02e-47a0-9076-3e01079b979e" returned: 0 in 0.488s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-quobyte-fad9a274-a02e-47a0-9076-3e01079b979e" released by "delete_volume" :: held 1.010s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Created reservations ['9c3b4e91-4144-4939-be25-16c17a3b0863', 'f4e33ce5-cf01-42d6-961a-6546b413bb91', 'ec5dfd2c-124d-4ed1-8865-e4586e2d1a3f', '4679fddf-ad44-4124-86a5-adf82f50fd1a'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:43 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc 1G" returned: 0 in 0.552s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:43 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:43 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:43 devstack sudo[88227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc Apr 15 22:25:43 devstack sudo[88227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:44 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bec7064b-c03c-4bc8-b8a8-2adb979a80e9" returned: 0 in 0.491s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Lock "cinder-quobyte-bec7064b-c03c-4bc8-b8a8-2adb979a80e9" released by "delete_volume" :: held 1.052s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Created reservations ['d8de6a1c-4996-415e-9aba-2f064035d4ff', '6b35e87f-5249-4787-af34-7a2877569a7e', 'c7ce4193-1727-4cfb-b552-75937a0bd317', 'cdc3e095-14b7-4a39-ad06-aa21124e95c4'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "cinder-1d8795bb-88ba-4b74-b7cd-098e02907020-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-1d8795bb-88ba-4b74-b7cd-098e02907020-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "cinder-quobyte-1d8795bb-88ba-4b74-b7cd-098e02907020" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-quobyte-1d8795bb-88ba-4b74-b7cd-098e02907020" acquired by "delete_volume" :: waited 0.026s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a88a1d-b066-4945-9edf-bf4b243be1bd]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:44 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:44 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:44 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.434s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:44 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Deleted volume successfully. Apr 15 22:25:44 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 Apr 15 22:25:44 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-571700d0-628c-4a8d-a098-db84451c3df1 tempest-CreateVolumesFromSourceVolumeTest-1711209260 None] Lock "cinder-fad9a274-a02e-47a0-9076-3e01079b979e-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:44 devstack sudo[88227]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" returned: 0 in 0.479s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:44 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc is being set with open permissions: ugo+rw Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:44 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc Apr 15 22:25:44 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:44 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.438s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:44 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Deleted volume successfully. Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d0f01907-9ce6-4a1f-b59c-913b0e6c0407 tempest-VolumesTestJSON-974141822 None] Lock "cinder-bec7064b-c03c-4bc8-b8a8-2adb979a80e9-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:44 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020" returned: 0 in 0.494s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:44 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020 Apr 15 22:25:44 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:44 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" returned: 0 in 0.444s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:44 devstack sudo[88248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.info Apr 15 22:25:44 devstack sudo[88248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:45 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1d8795bb-88ba-4b74-b7cd-098e02907020" returned: 0 in 0.498s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-quobyte-1d8795bb-88ba-4b74-b7cd-098e02907020" released by "delete_volume" :: held 1.052s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Created reservations ['f0be713a-2478-402e-bfc3-60a9e70cab43', '68312273-114b-427d-907c-ccb1809be285', '22e9a646-3e9e-4e98-8ec7-54e3355a25f8', 'a6f884d8-51f2-4ee4-9051-5f854e3440ed'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:45 devstack sudo[88248]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.info" returned: 0 in 0.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:45 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.info is being set with open permissions: ugo+rw Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:45 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:25:45 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:45 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.info Apr 15 22:25:45 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:45 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.528s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:25:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Deleted volume successfully. Apr 15 22:25:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ae1fd1a5-3c92-4565-a30a-d7a0f623e8f7 tempest-VolumesSnapshotNegativeTestJSON-1086553152 None] Lock "cinder-1d8795bb-88ba-4b74-b7cd-098e02907020-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:46 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.info" returned: 0 in 0.567s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-df4f05c0-a691-4a80-ad5c-af53a79a59a1" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-df4f05c0-a691-4a80-ad5c-af53a79a59a1" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] snapshot: b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc, volume: df4f05c0-a691-4a80-ad5c-af53a79a59a1, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2965809-a490-4142-b575-447a07733476]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:46 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc Apr 15 22:25:46 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:46 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" returned: 0 in 0.579s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f93cdc-39d8-4434-93dd-2d02ce859e8d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:46 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 Apr 15 22:25:46 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (1243be7f-7aea-4c32-82b3-42aa3dabaf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd2c6e8-9537-4736-a73d-c8665bcfaa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd2c6e8-9537-4736-a73d-c8665bcfaa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116367038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5135881b-c446-4927-8301-034bf3101725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637afdfc4c874fb3acf4effa91ca04f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:47Z,use_quota=True,user_id='36b43d527b5f4dd2bfb5cd68adfe21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5678dd6-84f1-461d-9ac8-2ff682102bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5678dd6-84f1-461d-9ac8-2ff682102bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d9862b-a4b8-4075-b5be-eed38cf79772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d9862b-a4b8-4075-b5be-eed38cf79772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5135881b-c446-4927-8301-034bf3101725', 'volume_name': 'volume-5135881b-c446-4927-8301-034bf3101725', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380c351f-b85c-4c5f-9b99-467d920260a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380c351f-b85c-4c5f-9b99-467d920260a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6fc53c-e4d3-4802-b202-a5fc0a4de44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:47 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Volume 5135881b-c446-4927-8301-034bf3101725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5135881b-c446-4927-8301-034bf3101725', 'volume_size': 1} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:47 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" returned: 0 in 0.669s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:25:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:47 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 Apr 15 22:25:47 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (aff16d7d-c162-40ce-9dc0-f72d344401ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b19386b-a7df-4f6f-a159-3be7655f0f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b19386b-a7df-4f6f-a159-3be7655f0f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982180673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a476619e-01af-41fa-9283-d9d29c694400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:49Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae522fe-d536-4c29-bde0-14cd5dc37ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae522fe-d536-4c29-bde0-14cd5dc37ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8d7082-dc1d-4c06-852c-2e3c09af5807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8d7082-dc1d-4c06-852c-2e3c09af5807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a476619e-01af-41fa-9283-d9d29c694400', 'volume_name': 'volume-a476619e-01af-41fa-9283-d9d29c694400', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95000c42-89fc-4f87-aa14-bb956e30c2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95000c42-89fc-4f87-aa14-bb956e30c2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38ccaa3-991c-48dd-be34-47551c801ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Volume a476619e-01af-41fa-9283-d9d29c694400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a476619e-01af-41fa-9283-d9d29c694400', 'volume_size': 1} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (517bd05f-a393-462d-bf70-b60df35d2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43aa0576-9d1e-4741-bc11-502efba11d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43aa0576-9d1e-4741-bc11-502efba11d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76234213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30444af2-c83c-43c1-a358-0c16f78be62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c79293-fa87-4ed1-8da0-4b1de77ed70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c79293-fa87-4ed1-8da0-4b1de77ed70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf964477-db60-4f38-94ee-adb5d3101b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf964477-db60-4f38-94ee-adb5d3101b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30444af2-c83c-43c1-a358-0c16f78be62b', 'volume_name': 'volume-30444af2-c83c-43c1-a358-0c16f78be62b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5a433c-0cb7-4d61-9c9e-f75b852ed826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c5a433c-0cb7-4d61-9c9e-f75b852ed826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e479b369-49f4-421b-aaa9-a53e89b0b8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:49 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Volume 30444af2-c83c-43c1-a358-0c16f78be62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30444af2-c83c-43c1-a358-0c16f78be62b', 'volume_size': 1} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:49 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1" returned: 0 in 2.548s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6952cf9e-30ff-4f12-ba08-79c89c201709]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:49 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 Apr 15 22:25:49 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:49 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (4ec98f63-7463-4f21-b389-9c2abd663839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3d3801-cd55-48ef-8432-0d4f931f4bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3d3801-cd55-48ef-8432-0d4f931f4bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1739478015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d2da4b-7295-49c9-b5b0-fc4d6eba1833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3ea795-a691-4484-9e3e-cc06ae20777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd3ea795-a691-4484-9e3e-cc06ae20777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6946d74-3907-422f-9a5b-4ae80e367df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6946d74-3907-422f-9a5b-4ae80e367df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d2da4b-7295-49c9-b5b0-fc4d6eba1833', 'volume_name': 'volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a081f05a-56f2-4158-a892-713feb5a608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a081f05a-56f2-4158-a892-713feb5a608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9b022d-72bc-4d69-af9a-76c38f004d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Volume 61d2da4b-7295-49c9-b5b0-fc4d6eba1833: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833', 'volume_size': 1} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (624ece89-5665-4afb-a2cf-7860e5fc677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf87b02-2fac-4479-be24-5a43914daa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cf87b02-2fac-4479-be24-5a43914daa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256788183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce997a-412a-4e34-a5c3-904a50e8ff17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633c1190-2393-45b0-a332-cbd048671dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633c1190-2393-45b0-a332-cbd048671dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2205611-037e-4710-8f3a-9ce38154373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2205611-037e-4710-8f3a-9ce38154373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86ce997a-412a-4e34-a5c3-904a50e8ff17', 'volume_name': 'volume-86ce997a-412a-4e34-a5c3-904a50e8ff17', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677e869-f619-4c1f-8d32-324c26b0750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b677e869-f619-4c1f-8d32-324c26b0750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabfe258-967c-4ae0-941a-5dc28645c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Volume 86ce997a-412a-4e34-a5c3-904a50e8ff17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86ce997a-412a-4e34-a5c3-904a50e8ff17', 'volume_size': 1} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (5faab58c-9040-41a4-bd66-91d87a413693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6d04e0-f3a5-4890-a46e-9111d2c78d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6d04e0-f3a5-4890-a46e-9111d2c78d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055649038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791abfe3-e002-4d35-b914-93ef0682c324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b644f9-8ac6-44e7-9248-76e93a235393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b644f9-8ac6-44e7-9248-76e93a235393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b44efd-7538-4110-b600-45ce982c85ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b44efd-7538-4110-b600-45ce982c85ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791abfe3-e002-4d35-b914-93ef0682c324', 'volume_name': 'volume-791abfe3-e002-4d35-b914-93ef0682c324', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1e287e-c073-4486-8f0f-3a7ef011d266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1e287e-c073-4486-8f0f-3a7ef011d266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c651d0-2fcb-4585-ab1c-ccf406a80b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:50 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Volume 791abfe3-e002-4d35-b914-93ef0682c324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791abfe3-e002-4d35-b914-93ef0682c324', 'volume_size': 1} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:50 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" returned: 0 in 0.821s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2, size 1024.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:25:50 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Converted 1024.00 MB image at 401.80 MB/s Apr 15 22:25:50 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 is being set with open permissions: ugo+rw Apr 15 22:25:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:50 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 Apr 15 22:25:50 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:51 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1" returned: 0 in 0.446s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-df4f05c0-a691-4a80-ad5c-af53a79a59a1" released by "_copy_volume_from_snapshot" :: held 5.120s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Deleting offline snapshot b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc of volume f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] snapshot_file for this snap is: volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb984aa-9fa8-4bf8-9252-37d60600c129]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:51 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc Apr 15 22:25:51 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:51 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" returned: 0 in 0.515s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dae2ee-dbe3-48ca-8bdd-5ffb59f88a03]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:25:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:51 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 Apr 15 22:25:51 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:52 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" returned: 0 in 0.460s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:52 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc Apr 15 22:25:52 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:52 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" returned: 0 in 0.473s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:52 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc Apr 15 22:25:52 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d43ca1d1-9a90-4a85-8934-0fd465b9f954 tempest-BackendsCapabilitiesAdminTestsJSON-1956846693 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.673397064209, 'free_capacity_gb': 1775.673397064209, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81921) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 22:25:53 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2.b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" returned: 0 in 0.409s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-b57afd67-bb2b-4a49-a9e0-558d4b5a5ddc" released by "_delete_snapshot" :: held 1.901s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.290s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.085s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116367038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5135881b-c446-4927-8301-034bf3101725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637afdfc4c874fb3acf4effa91ca04f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:47Z,use_quota=True,user_id='36b43d527b5f4dd2bfb5cd68adfe21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Creating volume 5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:53 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e422779-f130-46db-8423-1266d97a1230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1', 'volume_size': 1, 'source_volid': 'f69e320b-7fd8-4dc1-9b6f-88a62047e2a2', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:53 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 1073741824 Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555c82e7-2438-4b87-92ba-397c3acc7beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:53 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:53 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Volume volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 (df4f05c0-a691-4a80-ad5c-af53a79a59a1): created successfully Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555c82e7-2438-4b87-92ba-397c3acc7beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (a8ae94e1-02a5-4630-b75f-7737f49529d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-52c26527-094d-4678-8052-7c1ab58e8b90 tempest-VolumesGetTest-1533517202 None] Created volume successfully. Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-0c512483-3811-451b-a241-db7e063b6501 tempest-BackendsCapabilitiesAdminTestsJSON-1956846693 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.673397064209, 'free_capacity_gb': 1775.673397064209, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81921) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 22:25:53 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 1073741824" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:53 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 Apr 15 22:25:53 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:53 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (9bae22a9-a4ec-4466-9a6c-492dcfdcd92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff68e63-770b-4162-9afe-dac82ef46df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff68e63-770b-4162-9afe-dac82ef46df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-409313884',display_name='tempest-VolumesGetTest-Volume-267489238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcc52f3-cd34-4360-a84f-66de99bb29ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:54Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965d1ddc-5adb-4961-9e74-a2fcbada5c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965d1ddc-5adb-4961-9e74-a2fcbada5c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72ec17a-6241-479a-8f91-eae6be2b97de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72ec17a-6241-479a-8f91-eae6be2b97de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bcc52f3-cd34-4360-a84f-66de99bb29ec', 'volume_name': 'volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88b5038-c198-44fa-a34e-a8a69eec29f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a88b5038-c198-44fa-a34e-a8a69eec29f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc38fe2-0031-4f41-96c1-2d4eb8885a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:54 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Volume 0bcc52f3-cd34-4360-a84f-66de99bb29ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec', 'volume_size': 1} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:54 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725" returned: 0 in 0.435s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.564s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982180673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a476619e-01af-41fa-9283-d9d29c694400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:49Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Creating volume a476619e-01af-41fa-9283-d9d29c694400 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:54 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6fc53c-e4d3-4802-b202-a5fc0a4de44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5135881b-c446-4927-8301-034bf3101725', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd07bc7-41a7-4a87-9d5c-ebc0ed563911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:54 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 1073741824 Apr 15 22:25:54 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:54 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Volume volume-5135881b-c446-4927-8301-034bf3101725 (5135881b-c446-4927-8301-034bf3101725): created successfully Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd07bc7-41a7-4a87-9d5c-ebc0ed563911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (1243be7f-7aea-4c32-82b3-42aa3dabaf9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-61e4c543-c213-450d-b49d-4706cc696f41 tempest-VolumeDependencyTests-1128225397 None] Created volume successfully. Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:54 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 1073741824" returned: 0 in 0.657s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:54 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 Apr 15 22:25:54 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:55 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400" returned: 0 in 0.439s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.379s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-76234213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30444af2-c83c-43c1-a358-0c16f78be62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Creating volume 30444af2-c83c-43c1-a358-0c16f78be62b {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:55 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38ccaa3-991c-48dd-be34-47551c801ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a476619e-01af-41fa-9283-d9d29c694400', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039ec92d-c6d1-4239-ab52-518d5569b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:55 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b 1073741824 Apr 15 22:25:55 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:55 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Volume volume-a476619e-01af-41fa-9283-d9d29c694400 (a476619e-01af-41fa-9283-d9d29c694400): created successfully Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039ec92d-c6d1-4239-ab52-518d5569b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (aff16d7d-c162-40ce-9dc0-f72d344401ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-47b488c4-e4ee-4bdf-b44b-9c777c8e8286 tempest-CreateVolumesFromImageTest-1027427207 None] Created volume successfully. Apr 15 22:25:55 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b 1073741824" returned: 0 in 0.498s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:55 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b Apr 15 22:25:55 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:56 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b" returned: 0 in 0.468s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.168s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1739478015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d2da4b-7295-49c9-b5b0-fc4d6eba1833,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Creating volume 61d2da4b-7295-49c9-b5b0-fc4d6eba1833 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:56 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e479b369-49f4-421b-aaa9-a53e89b0b8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30444af2-c83c-43c1-a358-0c16f78be62b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11becc45-1d27-4ba3-87ea-7dcaffc53419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:56 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 1073741824 Apr 15 22:25:56 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:56 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Volume volume-30444af2-c83c-43c1-a358-0c16f78be62b (30444af2-c83c-43c1-a358-0c16f78be62b): created successfully Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11becc45-1d27-4ba3-87ea-7dcaffc53419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (517bd05f-a393-462d-bf70-b60df35d2522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:56 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ed32162e-6917-4171-bfd9-5b7d086e102a tempest-CreateVolumesFromImageTest-1027427207 None] Created volume successfully. Apr 15 22:25:56 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 1073741824" returned: 0 in 0.565s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:56 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 Apr 15 22:25:56 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:57 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833" returned: 0 in 0.462s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-256788183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86ce997a-412a-4e34-a5c3-904a50e8ff17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Creating volume 86ce997a-412a-4e34-a5c3-904a50e8ff17 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:57 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9b022d-72bc-4d69-af9a-76c38f004d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb765a0-2f9a-48d0-9651-bd17d16c2f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:57 devstack sudo[88340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 1073741824 Apr 15 22:25:57 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:57 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Volume volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 (61d2da4b-7295-49c9-b5b0-fc4d6eba1833): created successfully Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eb765a0-2f9a-48d0-9651-bd17d16c2f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (4ec98f63-7463-4f21-b389-9c2abd663839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:57 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-cfecdf86-1bfd-49fe-8c40-d0ad2f8e4137 tempest-CreateVolumesFromImageTest-1027427207 None] Created volume successfully. Apr 15 22:25:57 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 1073741824" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:57 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 Apr 15 22:25:57 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:58 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17" returned: 0 in 0.479s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.798s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055649038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791abfe3-e002-4d35-b914-93ef0682c324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3589628b3ea5458fbe413fcbab12542f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:50Z,use_quota=True,user_id='0b7c57342df24dcd93885948abab484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Creating volume 791abfe3-e002-4d35-b914-93ef0682c324 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:58 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabfe258-967c-4ae0-941a-5dc28645c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86ce997a-412a-4e34-a5c3-904a50e8ff17', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a295b8-857e-4613-a6e4-ac633aa1bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:58 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Volume volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 (86ce997a-412a-4e34-a5c3-904a50e8ff17): created successfully Apr 15 22:25:58 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 1073741824 Apr 15 22:25:58 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a295b8-857e-4613-a6e4-ac633aa1bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (624ece89-5665-4afb-a2cf-7860e5fc677b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:58 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b0f83f1c-dee6-415d-8ecb-883ce853f9d8 tempest-CreateVolumesFromImageTest-1027427207 None] Created volume successfully. Apr 15 22:25:58 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 1073741824" returned: 0 in 0.555s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:58 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 Apr 15 22:25:58 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:59 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324" returned: 0 in 0.425s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.270s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:25:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-409313884',display_name='tempest-VolumesGetTest-Volume-267489238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bcc52f3-cd34-4360-a84f-66de99bb29ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:25:54Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Creating volume 0bcc52f3-cd34-4360-a84f-66de99bb29ec {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:25:59 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c651d0-2fcb-4585-ab1c-ccf406a80b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791abfe3-e002-4d35-b914-93ef0682c324', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc62e65-9833-47c6-9169-b52cac30ba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:25:59 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec 1073741824 Apr 15 22:25:59 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:25:59 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Volume volume-791abfe3-e002-4d35-b914-93ef0682c324 (791abfe3-e002-4d35-b914-93ef0682c324): created successfully Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc62e65-9833-47c6-9169-b52cac30ba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Flow 'volume_create_manager' (5faab58c-9040-41a4-bd66-91d87a413693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:25:59 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b8a674b3-e4a9-4c9b-bbea-d4e7c117e613 tempest-CreateVolumesFromImageTest-1027427207 None] Created volume successfully. Apr 15 22:25:59 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec 1073741824" returned: 0 in 0.534s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:25:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:25:59 devstack sudo[88361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec Apr 15 22:25:59 devstack sudo[88361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-791abfe3-e002-4d35-b914-93ef0682c324-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-791abfe3-e002-4d35-b914-93ef0682c324-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-quobyte-791abfe3-e002-4d35-b914-93ef0682c324" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-791abfe3-e002-4d35-b914-93ef0682c324" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0358afa6-908b-4d4b-b715-0abee0e8c390]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:00 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 Apr 15 22:26:00 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:00 devstack sudo[88361]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec" returned: 0 in 0.501s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.925s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc38fe2-0031-4f41-96c1-2d4eb8885a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb440fd-4359-48b2-83a6-bb523e1390d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Creating offline snapshot eb66c3e6-53dc-4bc0-aa4c-15f68af52297 of volume 5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:00 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Volume volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec (0bcc52f3-cd34-4360-a84f-66de99bb29ec): created successfully Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb440fd-4359-48b2-83a6-bb523e1390d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (9bae22a9-a4ec-4466-9a6c-492dcfdcd92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[630aa211-9932-4426-b0e5-a068159b8664]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2b2f849b-68d6-4202-a4eb-96a1d45024e7 tempest-VolumesGetTest-1533517202 None] Created volume successfully. Apr 15 22:26:00 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 Apr 15 22:26:00 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Flow 'volume_create_manager' (38671601-cfda-406c-b1a3-ee5ad3241fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85900847-02ec-4888-bcf6-7d8ea2368998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85900847-02ec-4888-bcf6-7d8ea2368998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-837364499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49bd518-bb00-4d0b-ae46-c55be739f3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64306ead7204f31a9dd6d89a2d1b6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:01Z,use_quota=True,user_id='412e46fd048c46419f7ffa2b56f970e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556edc4f-ba43-48b9-b1f7-2cd606a8c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556edc4f-ba43-48b9-b1f7-2cd606a8c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84b5b91-1155-4637-bf22-c43acc9071f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84b5b91-1155-4637-bf22-c43acc9071f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49bd518-bb00-4d0b-ae46-c55be739f3bb', 'volume_name': 'volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924da05d-259f-40c5-9a68-9521dea9fea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924da05d-259f-40c5-9a68-9521dea9fea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a71568c-daee-41f7-b835-1bdf9859e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:00 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Volume d49bd518-bb00-4d0b-ae46-c55be739f3bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb', 'volume_size': 1} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:00 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324" returned: 0 in 0.544s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:00 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324 Apr 15 22:26:00 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:00 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:01 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 1G Apr 15 22:26:01 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:01 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-791abfe3-e002-4d35-b914-93ef0682c324" returned: 0 in 0.407s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-791abfe3-e002-4d35-b914-93ef0682c324" released by "delete_volume" :: held 0.972s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Created reservations ['de1bf0ee-3b01-407b-9ed1-ef6e13e7f7fb', '695b2367-d632-4ab8-b9d6-d9ff0f1c8639', '6374d7c6-7578-475c-ace9-e7281c6146ba', 'f70e6736-3c0d-4a3a-b5a0-9e579259f71d'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:01 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:01 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-0bcc52f3-cd34-4360-a84f-66de99bb29ec-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:01 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Lock "cinder-0bcc52f3-cd34-4360-a84f-66de99bb29ec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 1G" returned: 0 in 0.543s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5135881b-c446-4927-8301-034bf3101725 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:01 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5135881b-c446-4927-8301-034bf3101725 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 Apr 15 22:26:01 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-0bcc52f3-cd34-4360-a84f-66de99bb29ec" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-0bcc52f3-cd34-4360-a84f-66de99bb29ec" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2219e52f-5c8e-4c7a-b36a-915af4598e6e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:01 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec Apr 15 22:26:01 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:01 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.507s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:01 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Deleted volume successfully. Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ee1ffe78-88f8-44f2-8b76-8dcb8c0f0e27 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-791abfe3-e002-4d35-b914-93ef0682c324-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:01 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5135881b-c446-4927-8301-034bf3101725 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:01 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 is being set with open permissions: ugo+rw Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:02 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 Apr 15 22:26:02 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:02 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:02 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec Apr 15 22:26:02 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-86ce997a-412a-4e34-a5c3-904a50e8ff17-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-86ce997a-412a-4e34-a5c3-904a50e8ff17-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-quobyte-86ce997a-412a-4e34-a5c3-904a50e8ff17" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-86ce997a-412a-4e34-a5c3-904a50e8ff17" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c560a22-43ef-4aca-933c-3532e4346231]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:02 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297" returned: 0 in 0.450s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:02 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 Apr 15 22:26:02 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:02 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.info Apr 15 22:26:02 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:02 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-0bcc52f3-cd34-4360-a84f-66de99bb29ec" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-0bcc52f3-cd34-4360-a84f-66de99bb29ec" released by "delete_volume" :: held 1.019s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Created reservations ['081b4277-9a20-47d4-b000-27f476e205aa', '545c7e41-6b92-450b-aa8a-e74e517ab4cc', 'a4d6e0ea-2b73-4534-b138-8e674c32dfaf', 'eadf976e-3ba9-4003-ae24-9c6ba2bef5e2'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:02 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:02 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:02 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:02 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17 Apr 15 22:26:02 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:02 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.info" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:02 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.info is being set with open permissions: ugo+rw Apr 15 22:26:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:02 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.info Apr 15 22:26:02 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:03 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.441s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:03 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Deleted volume successfully. Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-cadf2485-407e-4635-97df-d1fd71e5f8ec tempest-VolumesGetTest-1533517202 None] Lock "cinder-0bcc52f3-cd34-4360-a84f-66de99bb29ec-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:03 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.info" returned: 0 in 0.429s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.724s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:03 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-837364499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49bd518-bb00-4d0b-ae46-c55be739f3bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f64306ead7204f31a9dd6d89a2d1b6d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:01Z,use_quota=True,user_id='412e46fd048c46419f7ffa2b56f970e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Creating volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:03 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:03 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb 1073741824 Apr 15 22:26:03 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-86ce997a-412a-4e34-a5c3-904a50e8ff17" returned: 0 in 0.513s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-86ce997a-412a-4e34-a5c3-904a50e8ff17" released by "delete_volume" :: held 1.076s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:03 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a980b1b2-00a8-4daf-b9ff-de441571f0eb tempest-VolumeDependencyTests-1128225397 None] Create snapshot completed successfully Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Created reservations ['b22a605e-a8c0-43bb-83ac-8aa2ab71451b', 'a2ad07ef-65fa-4200-aa6e-84c33053fab2', 'db16badf-b992-4463-9979-e76795b0fa31', 'dd71f580-2825-4f6b-8dab-77aaca8ff286'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:03 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:03 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-df4f05c0-a691-4a80-ad5c-af53a79a59a1-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Lock "cinder-df4f05c0-a691-4a80-ad5c-af53a79a59a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-df4f05c0-a691-4a80-ad5c-af53a79a59a1" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-df4f05c0-a691-4a80-ad5c-af53a79a59a1" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2e899a-c698-4aaf-99e4-8d926d018cf6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:03 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb 1073741824" returned: 0 in 0.552s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:03 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 Apr 15 22:26:03 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:03 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb Apr 15 22:26:03 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:04 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.511s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Deleted volume successfully. Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b2f93e21-5b4f-4f6d-9526-c7e0c437ced8 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-86ce997a-412a-4e34-a5c3-904a50e8ff17-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (5c8ccbcd-e420-49fa-a52d-6d8cc8ad4530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34881595-5bd8-4fa3-ad00-991356a543ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34881595-5bd8-4fa3-ad00-991356a543ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1413172042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23174ee4-d8bf-4afb-b452-3808d6a5bfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637afdfc4c874fb3acf4effa91ca04f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eb66c3e6-53dc-4bc0-aa4c-15f68af52297,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:04Z,use_quota=True,user_id='36b43d527b5f4dd2bfb5cd68adfe21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb487a0-c90e-45d0-baac-83b56d582eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eb487a0-c90e-45d0-baac-83b56d582eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c850f2d-2eab-4f34-97b7-d218d87f5cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c850f2d-2eab-4f34-97b7-d218d87f5cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23174ee4-d8bf-4afb-b452-3808d6a5bfcf', 'volume_name': 'volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf', 'volume_size': 1, 'snapshot_id': 'eb66c3e6-53dc-4bc0-aa4c-15f68af52297'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b77aa5-c785-4e5a-bcfc-7e9c47681720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b77aa5-c785-4e5a-bcfc-7e9c47681720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68d4781-4fbb-455f-8ce8-aa7f94e6250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:04 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Volume 23174ee4-d8bf-4afb-b452-3808d6a5bfcf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf', 'volume_size': 1, 'snapshot_id': 'eb66c3e6-53dc-4bc0-aa4c-15f68af52297'} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:04 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1" returned: 0 in 0.511s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:04 devstack sudo[88441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1 Apr 15 22:26:04 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:04 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.230s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-eb66c3e6-53dc-4bc0-aa4c-15f68af52297-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a71568c-daee-41f7-b835-1bdf9859e63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a2958a-6f1b-4f6b-adfc-7511c34b42aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:04 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Volume volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb (d49bd518-bb00-4d0b-ae46-c55be739f3bb): created successfully Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a2958a-6f1b-4f6b-adfc-7511c34b42aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Flow 'volume_create_manager' (38671601-cfda-406c-b1a3-ee5ad3241fd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-eb66c3e6-53dc-4bc0-aa4c-15f68af52297-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Creating volume 23174ee4-d8bf-4afb-b452-3808d6a5bfcf from snapshot eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e012821f-a94b-4c1d-bdfc-dbbb331c9846 tempest-SnapshotsActionsTest-1720222433 None] Created volume successfully. Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] snapshot: eb66c3e6-53dc-4bc0-aa4c-15f68af52297, volume: 23174ee4-d8bf-4afb-b452-3808d6a5bfcf, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-61d2da4b-7295-49c9-b5b0-fc4d6eba1833-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8b6be9-5b8b-4e7c-8b0c-304834ef544e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-61d2da4b-7295-49c9-b5b0-fc4d6eba1833-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-quobyte-61d2da4b-7295-49c9-b5b0-fc4d6eba1833" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-61d2da4b-7295-49c9-b5b0-fc4d6eba1833" acquired by "delete_volume" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[20949063-c9f1-4a5b-89b9-2408874699b9]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:04 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 Apr 15 22:26:04 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:04 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 Apr 15 22:26:04 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:04 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-df4f05c0-a691-4a80-ad5c-af53a79a59a1" returned: 0 in 0.431s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-df4f05c0-a691-4a80-ad5c-af53a79a59a1" released by "delete_volume" :: held 0.970s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Created reservations ['1cebffef-0597-4654-9510-b920991954cc', 'c82f891b-abcb-4d35-80e3-3ed5a400e731', '26301181-3fef-4780-acac-d23d6662685e', '3a13e2fe-25ae-42ca-834c-e27f974deb55'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:04 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:04 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:05 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297" returned: 0 in 0.532s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5135881b-c446-4927-8301-034bf3101725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5417114f-4fe7-4a95-99fd-addae1d6100c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:05 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 Apr 15 22:26:05 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:05 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833" returned: 0 in 0.617s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:05 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833 Apr 15 22:26:05 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:05 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.450s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:05 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Deleted volume successfully. Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-abc4bc0d-421d-45c1-92d0-c0da8e1eeb8d tempest-VolumesGetTest-1533517202 None] Lock "cinder-df4f05c0-a691-4a80-ad5c-af53a79a59a1-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:05 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725" returned: 0 in 0.505s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:05 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf Apr 15 22:26:05 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:05 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-61d2da4b-7295-49c9-b5b0-fc4d6eba1833" returned: 0 in 0.422s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-61d2da4b-7295-49c9-b5b0-fc4d6eba1833" released by "delete_volume" :: held 1.061s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Created reservations ['a7c3b0f6-4c2a-4063-93f8-50941dc49948', '7f318435-9061-45e4-b304-4a326803eb69', '40138102-7f94-4651-9c6e-e2dd9eaa56b9', '0d6e6af8-a735-420a-a18f-727b7b0186ba'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:05 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:05 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Lock "cinder-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b0f844-9f12-4056-bc31-159787263646]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:06 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 Apr 15 22:26:06 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:06 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.829s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:06 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Deleted volume successfully. Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-88e33f89-c3cc-4855-813a-1940b0ad56a3 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-61d2da4b-7295-49c9-b5b0-fc4d6eba1833-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-30444af2-c83c-43c1-a358-0c16f78be62b-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-30444af2-c83c-43c1-a358-0c16f78be62b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-quobyte-30444af2-c83c-43c1-a358-0c16f78be62b" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:07 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-30444af2-c83c-43c1-a358-0c16f78be62b" acquired by "delete_volume" :: waited 0.117s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:07 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[108a8018-07bc-487c-8de8-c25d6004179e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:07 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b Apr 15 22:26:07 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:07 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" returned: 0 in 1.207s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:07 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2 Apr 15 22:26:07 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:08 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b" returned: 0 in 0.920s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:08 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b Apr 15 22:26:08 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:08 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" returned: 0 in 2.493s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b928e22b-9dd5-4909-943c-54d74a4238dd]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:08 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 Apr 15 22:26:08 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:08 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" returned: 0 in 0.876s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2" released by "delete_volume" :: held 2.140s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Created reservations ['07a89d11-ffd3-4abe-b95e-7b953d426c3c', 'ba6ceca5-8a72-450a-b144-9005bfe197df', '39dba7c6-ae7b-449e-b612-7fe575d744c9', '483a4620-b4f6-43f2-b55f-c5edf1a2b382'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:08 devstack sudo[88497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:08 devstack sudo[88497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:08 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-30444af2-c83c-43c1-a358-0c16f78be62b" returned: 0 in 0.515s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-30444af2-c83c-43c1-a358-0c16f78be62b" released by "delete_volume" :: held 1.498s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Created reservations ['ac7831f4-b3cd-4f9a-b521-3a97854fd103', '92dbf8a3-cd5d-423a-907c-5a8c60030d5a', 'f55bb5df-6ae2-4d18-b74d-3b2109a378e8', '60c7131a-afe0-4bf3-acc4-0bae406586ef'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:08 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:08 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:08 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725" returned: 0 in 0.674s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:26:08 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Converted 1024.00 MB image at 410.49 MB/s Apr 15 22:26:08 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf is being set with open permissions: ugo+rw Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:08 devstack sudo[88497]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Deleted volume successfully. Apr 15 22:26:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b90b9a44-29fa-40db-aaa9-030de3714c22 tempest-VolumesGetTest-1533517202 None] Lock "cinder-f69e320b-7fd8-4dc1-9b6f-88a62047e2a2-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:08 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf Apr 15 22:26:08 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:09 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.428s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Deleted volume successfully. Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-15f638f1-d1c4-4f6b-a658-5eda4300e51c tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-30444af2-c83c-43c1-a358-0c16f78be62b-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-a476619e-01af-41fa-9283-d9d29c694400-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-a476619e-01af-41fa-9283-d9d29c694400-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "cinder-quobyte-a476619e-01af-41fa-9283-d9d29c694400" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-a476619e-01af-41fa-9283-d9d29c694400" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dde26da-97ee-4d51-8d19-65c5f27e2dc0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:09 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 Apr 15 22:26:09 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:09 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" returned: 0 in 0.496s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" released by "_copy_volume_from_snapshot" :: held 4.767s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-eb66c3e6-53dc-4bc0-aa4c-15f68af52297-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" released by "_create_volume_from_snapshot" :: held 4.795s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.847s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.280s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Creating offline snapshot c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68d4781-4fbb-455f-8ce8-aa7f94e6250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf', 'volume_size': 1, 'snapshot_id': 'eb66c3e6-53dc-4bc0-aa4c-15f68af52297'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d9a94b-ed52-4c27-b0d5-1d73818362cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb60213f-c864-46bc-9745-ceb1586c95db]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:09 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Volume volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf (23174ee4-d8bf-4afb-b452-3808d6a5bfcf): created successfully Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d9a94b-ed52-4c27-b0d5-1d73818362cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (5c8ccbcd-e420-49fa-a52d-6d8cc8ad4530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c7d7dcc2-ac78-4c6c-aeb3-6c7cabce3e57 tempest-VolumeDependencyTests-1128225397 None] Created volume successfully. Apr 15 22:26:09 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb Apr 15 22:26:09 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (303c2fe7-1470-4e22-876d-1fa1c806b6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919a71c2-b846-4718-83de-3f6940c5b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919a71c2-b846-4718-83de-3f6940c5b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-829685083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da95f7f6-a43d-4cc2-9408-8752beb58981,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:10Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e654dd52-766b-4f84-9cc4-d3a6c068ba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e654dd52-766b-4f84-9cc4-d3a6c068ba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e5ee55-4a11-46fa-a46f-fc642ee53e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.image.glance [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Creating Keystone auth plugin from conf {{(pid=81921) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-eb66c3e6-53dc-4bc0-aa4c-15f68af52297-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-eb66c3e6-53dc-4bc0-aa4c-15f68af52297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-5135881b-c446-4927-8301-034bf3101725" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:09 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-5135881b-c446-4927-8301-034bf3101725" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-eb66c3e6-53dc-4bc0-aa4c-15f68af52297" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400" returned: 0 in 0.573s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-eb66c3e6-53dc-4bc0-aa4c-15f68af52297" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Deleting offline snapshot eb66c3e6-53dc-4bc0-aa4c-15f68af52297 of volume 5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:09 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400 Apr 15 22:26:09 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] snapshot_file for this snap is: volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b4d89-4a2f-440d-af5e-813876a8f888]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:09 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 Apr 15 22:26:09 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:09 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb" returned: 0 in 0.572s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:09 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 1G Apr 15 22:26:09 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e5ee55-4a11-46fa-a46f-fc642ee53e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da95f7f6-a43d-4cc2-9408-8752beb58981', 'volume_name': 'volume-da95f7f6-a43d-4cc2-9408-8752beb58981', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468b67dd-fc3c-4e68-a39e-149f43ebbf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468b67dd-fc3c-4e68-a39e-149f43ebbf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdfc64f-18d8-4e50-a361-f8403d7319db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:09 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Volume da95f7f6-a43d-4cc2-9408-8752beb58981: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da95f7f6-a43d-4cc2-9408-8752beb58981', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 22:26:09 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Trying to clone da95f7f6-a43d-4cc2-9408-8752beb58981 from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]). {{(pid=81921) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 22:26:10 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Image download 20.69 MB at 20.69 MB/s Apr 15 22:26:10 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a476619e-01af-41fa-9283-d9d29c694400" returned: 0 in 0.442s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-quobyte-a476619e-01af-41fa-9283-d9d29c694400" released by "delete_volume" :: held 1.055s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ea98a-adc7-48a8-b230-53b87cc5af96]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Created reservations ['18f7073c-b80e-48a5-8f3a-fdc912bfd9aa', '3b1bf7be-1905-416a-b976-e07e033e5fee', 'b6e0dd15-92ff-40a9-8c1c-ab8799c70499', 'f7dfbb00-1870-4848-88a2-fbfd23479ebf'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:10 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD Apr 15 22:26:10 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:10 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:10 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:10 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297" returned: 0 in 0.613s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5135881b-c446-4927-8301-034bf3101725(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b332e711-4be9-4279-bf58-78670559ce86]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:10 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 1G" returned: 0 in 0.572s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:10 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 Apr 15 22:26:10 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:10 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:10 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:10 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD" returned: 0 in 0.538s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd is fetched for user d27e279643104cbb9ee6f48f646dacd9. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 22:26:10 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:10 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Deleted volume successfully. Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99f66645-f6e8-4829-bd84-853d815abb10 tempest-CreateVolumesFromImageTest-1027427207 None] Lock "cinder-a476619e-01af-41fa-9283-d9d29c694400-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ade65a8-211e-4e70-b836-757916ca6e1f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:10 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD Apr 15 22:26:10 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:10 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725" returned: 0 in 0.519s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:10 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 Apr 15 22:26:10 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:10 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:10 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 is being set with open permissions: ugo+rw Apr 15 22:26:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:10 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:10 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:11 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD" returned: 0 in 0.590s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:11 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.471s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:11 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297" returned: 0 in 0.545s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:11 devstack sudo[88600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.info Apr 15 22:26:11 devstack sudo[88600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:11 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297 Apr 15 22:26:11 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:11 devstack sudo[88600]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.info" returned: 0 in 0.467s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:11 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.info is being set with open permissions: ugo+rw Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:11 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.info Apr 15 22:26:11 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:11 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725.eb66c3e6-53dc-4bc0-aa4c-15f68af52297" returned: 0 in 0.504s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-eb66c3e6-53dc-4bc0-aa4c-15f68af52297" released by "_delete_snapshot" :: held 2.245s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-5135881b-c446-4927-8301-034bf3101725" released by "delete_snapshot" :: held 2.279s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Created reservations ['651c3301-b372-481a-9b17-0ab4dabdc974', 'c46d7152-cab9-4e45-8af4-f1aee4c48687', '66279d57-8a47-4ada-bf5c-2f54df49e91e', '401c9fa7-248e-4950-8891-a98cb5475498'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:12 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Delete snapshot completed successfully. Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ace3c936-94bd-4fd7-9a13-309f381efc83 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-eb66c3e6-53dc-4bc0-aa4c-15f68af52297-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:12 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.info" returned: 0 in 0.512s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.172s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.057s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-829685083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da95f7f6-a43d-4cc2-9408-8752beb58981,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:10Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Creating volume da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:12 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:12 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 1073741824 Apr 15 22:26:12 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:12 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5aa52cc0-29b0-4243-a50f-f5ab8268cdf6 tempest-SnapshotsActionsTest-1720222433 None] Create snapshot completed successfully Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-5135881b-c446-4927-8301-034bf3101725-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-5135881b-c446-4927-8301-034bf3101725-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-5135881b-c446-4927-8301-034bf3101725" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-5135881b-c446-4927-8301-034bf3101725" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac4700-d9c4-45d8-9b49-0897083918cf]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:13 devstack sudo[88615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 Apr 15 22:26:13 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:13 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 1073741824" returned: 0 in 0.567s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:13 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 Apr 15 22:26:13 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:13 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725" returned: 0 in 0.597s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:13 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981" returned: 0 in 0.469s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Attempting download of 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume da95f7f6-a43d-4cc2-9408-8752beb58981. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 22:26:13 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725 Apr 15 22:26:13 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[14143651-18e3-4bbd-baa3-84904db38260]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_hdane7t8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:13 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_hdane7t8 Apr 15 22:26:13 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Creating offline snapshot c0f71867-bafa-4965-806f-30a28951243b of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e2735-286c-46e7-bcc5-7dcccf7ddeaa]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:14 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:14 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-5135881b-c446-4927-8301-034bf3101725" returned: 0 in 0.591s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:14 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-5135881b-c446-4927-8301-034bf3101725" released by "delete_volume" :: held 1.232s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Created reservations ['d4f1fcd0-2d04-4a24-82fc-53e9d7b83084', '8d12d3a7-b632-4f59-9720-f4cdbe572603', 'ddfc953c-e3de-4f8f-815d-4cd90a63f3ed', '35da0d61-2899-4fa5-bd39-057d5d153250'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:14 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_hdane7t8" returned: 0 in 0.608s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_hdane7t8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:14 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:14 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:14 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_hdane7t8 Apr 15 22:26:14 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:14 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.591s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:14 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b 1G Apr 15 22:26:14 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:14 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.493s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Deleted volume successfully. Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f6315ac-1b1a-4d79-bc23-1b4442827559 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-5135881b-c446-4927-8301-034bf3101725-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:14 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_hdane7t8" returned: 1 in 0.542s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_hdane7t8' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a49711e-3d1e-4270-8bd5-ff1bfaecb9df]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:14 devstack sudo[88644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD Apr 15 22:26:14 devstack sudo[88644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:15 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b 1G" returned: 0 in 0.642s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:15 devstack sudo[88644]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD" returned: 0 in 0.550s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd was qcow2, converting to raw {{(pid=81921) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:15 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b Apr 15 22:26:15 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:15 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 Apr 15 22:26:15 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (0e9dd654-36c9-4d26-8b33-dac4d360ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557ed9d7-cc8f-41f3-8cbd-7bb60c76e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557ed9d7-cc8f-41f3-8cbd-7bb60c76e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-866895965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1691f17-d975-4358-b899-7fa64e8067e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637afdfc4c874fb3acf4effa91ca04f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:15Z,use_quota=True,user_id='36b43d527b5f4dd2bfb5cd68adfe21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea196ce-d861-41c6-b1b4-05fb0a2af19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea196ce-d861-41c6-b1b4-05fb0a2af19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5972af5-97e9-4bca-acee-6022a5cc2e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5972af5-97e9-4bca-acee-6022a5cc2e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1691f17-d975-4358-b899-7fa64e8067e5', 'volume_name': 'volume-d1691f17-d975-4358-b899-7fa64e8067e5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e799dea-89b2-4a57-95c1-9c311c6c14b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e799dea-89b2-4a57-95c1-9c311c6c14b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af4af57-f5e2-4f9e-8b68-7da37eefb442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:15 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Volume d1691f17-d975-4358-b899-7fa64e8067e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1691f17-d975-4358-b899-7fa64e8067e5', 'volume_size': 1} Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:15 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b" returned: 0 in 0.542s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:15 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b is being set with open permissions: ugo+rw Apr 15 22:26:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:15 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b Apr 15 22:26:15 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:16 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981" returned: 0 in 1.006s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14bb1ee4-7b79-49ca-9eec-c5f117cf54bd_0ixy3l4ldevstack@QuobyteHD, size 112.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:26:16 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Converted 112.00 MB image at 111.19 MB/s Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:16 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 1G Apr 15 22:26:16 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:16 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b" returned: 0 in 0.573s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.417s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-866895965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1691f17-d975-4358-b899-7fa64e8067e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637afdfc4c874fb3acf4effa91ca04f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:15Z,use_quota=True,user_id='36b43d527b5f4dd2bfb5cd68adfe21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Creating volume d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:16 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-0f156918-5706-4e76-9672-60370fdb03e9 tempest-SnapshotsActionsTest-1720222433 None] Create snapshot completed successfully Apr 15 22:26:16 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 1073741824 Apr 15 22:26:16 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:16 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 1G" returned: 0 in 0.579s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f62c843-1b6c-43c3-9008-b87d981d8077]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:16 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 Apr 15 22:26:16 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:16 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 1073741824" returned: 0 in 0.569s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:17 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 Apr 15 22:26:17 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-c0f71867-bafa-4965-806f-30a28951243b-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-c0f71867-bafa-4965-806f-30a28951243b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-c0f71867-bafa-4965-806f-30a28951243b" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-c0f71867-bafa-4965-806f-30a28951243b" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Deleting offline snapshot c0f71867-bafa-4965-806f-30a28951243b of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] snapshot_file for this snap is: volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebc00ac-2b41-4ed4-b26f-3660e622c891]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:17 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:17 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:17 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b Apr 15 22:26:17 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:17 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5" returned: 0 in 0.758s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af4af57-f5e2-4f9e-8b68-7da37eefb442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1691f17-d975-4358-b899-7fa64e8067e5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9186f34-a403-475d-a31c-05385adf70d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:17 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Volume volume-d1691f17-d975-4358-b899-7fa64e8067e5 (d1691f17-d975-4358-b899-7fa64e8067e5): created successfully Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9186f34-a403-475d-a31c-05385adf70d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (0e9dd654-36c9-4d26-8b33-dac4d360ee74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:17 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-958c0db2-56dd-4597-8ed5-e3adabd4e912 tempest-VolumeDependencyTests-1128225397 None] Created volume successfully. Apr 15 22:26:17 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981" returned: 0 in 0.967s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:18 devstack sudo[88691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 Apr 15 22:26:18 devstack sudo[88691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:18 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.690s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:18 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b" returned: 0 in 0.848s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d132f-57cc-43ba-aad7-abc65b5857e5]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:18 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:18 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:18 devstack sudo[88691]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981" returned: 1 in 0.700s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Downloaded image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd ((None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}])) to volume da95f7f6-a43d-4cc2-9408-8752beb58981 successfully. {{(pid=81921) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Temporary image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd for user d27e279643104cbb9ee6f48f646dacd9 is deleted. {{(pid=81921) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.volume_utils [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Marking volume da95f7f6-a43d-4cc2-9408-8752beb58981 as bootable. {{(pid=81921) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Copying metadata from image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd to da95f7f6-a43d-4cc2-9408-8752beb58981. {{(pid=81921) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Creating volume glance metadata for volume da95f7f6-a43d-4cc2-9408-8752beb58981 backed by image 14bb1ee4-7b79-49ca-9eec-c5f117cf54bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81921) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdfc64f-18d8-4e50-a361-f8403d7319db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da95f7f6-a43d-4cc2-9408-8752beb58981', 'volume_size': 1, 'image_id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'cc921a37a48c4c56855c255c767e2ae3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '14bb1ee4-7b79-49ca-9eec-c5f117cf54bd', 'created_at': datetime.datetime(2026, 4, 15, 20, 15, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 20, 15, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14bb1ee4-7b79-49ca-9eec-c5f117cf54bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a3e2f2-0c24-4715-a60b-45283557751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:18 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Volume volume-da95f7f6-a43d-4cc2-9408-8752beb58981 (da95f7f6-a43d-4cc2-9408-8752beb58981): created successfully Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0a3e2f2-0c24-4715-a60b-45283557751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (303c2fe7-1470-4e22-876d-1fa1c806b6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-79d110fe-cd8b-4ff7-9db1-e72561c6daad tempest-VolumesGetTest-1533517202 None] Created volume successfully. Apr 15 22:26:18 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.644s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:18 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b Apr 15 22:26:18 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:18 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (8d236266-06b6-4936-9b62-e982671a15c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418daff4-421d-4fbf-847b-61c116f58275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418daff4-421d-4fbf-847b-61c116f58275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1023532465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3b80e9-97e2-4741-ab2f-20f2a22286c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='637afdfc4c874fb3acf4effa91ca04f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d1691f17-d975-4358-b899-7fa64e8067e5,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:19Z,use_quota=True,user_id='36b43d527b5f4dd2bfb5cd68adfe21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c408580-33e7-43be-9d27-4b473554d096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c408580-33e7-43be-9d27-4b473554d096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7420ea41-c07b-40da-b605-bef16c8bce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7420ea41-c07b-40da-b605-bef16c8bce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fe3b80e9-97e2-4741-ab2f-20f2a22286c4', 'volume_name': 'volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4', 'volume_size': 1, 'source_volid': 'd1691f17-d975-4358-b899-7fa64e8067e5', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa945a8-e643-4f77-a11c-5c03d37d8053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa945a8-e643-4f77-a11c-5c03d37d8053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682eded4-9f40-47df-9ef6-01fdd7750401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Volume fe3b80e9-97e2-4741-ab2f-20f2a22286c4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4', 'volume_size': 1, 'source_volid': 'd1691f17-d975-4358-b899-7fa64e8067e5', 'source_volstatus': 'available'} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:19 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Cloning volume d1691f17-d975-4358-b899-7fa64e8067e5 to volume fe3b80e9-97e2-4741-ab2f-20f2a22286c4 Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Creating offline snapshot c65f1ff1-b4a2-438c-8c39-e189136fcb1b of volume d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f1e5e-0e8b-48aa-a3fe-dd579f333312]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:19 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 Apr 15 22:26:19 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:19 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b" returned: 0 in 0.604s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:19 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b Apr 15 22:26:19 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:19 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5" returned: 0 in 0.666s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:19 devstack sudo[88716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b 1G Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (36d95bb4-de4a-48ca-9b4d-bcd3fda1a26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:19 devstack sudo[88716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5c723e-2d63-40dc-8459-a3a62fc5f6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5c723e-2d63-40dc-8459-a3a62fc5f6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1353316585',display_name='tempest-VolumesGetTest-Volume-1613072421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a842a8c8-8d56-493b-be33-028ed5f5635b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:20Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f035ad-ef00-4227-a98b-f1a0bde6813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f035ad-ef00-4227-a98b-f1a0bde6813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d00be2-58d1-4c20-8ae6-d1f303458fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1d00be2-58d1-4c20-8ae6-d1f303458fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a842a8c8-8d56-493b-be33-028ed5f5635b', 'volume_name': 'volume-a842a8c8-8d56-493b-be33-028ed5f5635b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c8d23a-f462-45c4-b7e1-615c4239dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c8d23a-f462-45c4-b7e1-615c4239dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493d8b5d-f9b7-4a4a-926a-58ba15232186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:19 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Volume a842a8c8-8d56-493b-be33-028ed5f5635b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a842a8c8-8d56-493b-be33-028ed5f5635b', 'volume_size': 1} Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:19 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c0f71867-bafa-4965-806f-30a28951243b" returned: 0 in 0.582s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-c0f71867-bafa-4965-806f-30a28951243b" released by "_delete_snapshot" :: held 2.738s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" released by "delete_snapshot" :: held 2.748s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Created reservations ['1d094ab3-4ff8-4266-ad27-46c793e70b49', '8799c7be-6ba9-45e2-b14d-5abe75133893', '7da7dff1-bc82-497f-9afb-3e1c053f9d69', '9226f033-c6dc-4665-8891-9b2682fa4e57'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:20 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Delete snapshot completed successfully. Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-90102c26-4759-4b64-9192-db3454673cb3 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-c0f71867-bafa-4965-806f-30a28951243b-delete_snapshot" released by "delete_snapshot" :: held 2.910s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:20 devstack sudo[88716]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b 1G" returned: 0 in 0.538s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1691f17-d975-4358-b899-7fa64e8067e5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:20 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1691f17-d975-4358-b899-7fa64e8067e5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b Apr 15 22:26:20 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:20 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1691f17-d975-4358-b899-7fa64e8067e5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b" returned: 0 in 0.604s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:20 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b is being set with open permissions: ugo+rw Apr 15 22:26:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:20 devstack sudo[88727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b Apr 15 22:26:20 devstack sudo[88727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:21 devstack sudo[88727]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b" returned: 0 in 0.475s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:21 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.info Apr 15 22:26:21 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:21 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.info" returned: 0 in 0.461s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:21 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.info is being set with open permissions: ugo+rw Apr 15 22:26:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:21 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.info Apr 15 22:26:21 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:22 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.info" returned: 0 in 0.442s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] snapshot: c65f1ff1-b4a2-438c-8c39-e189136fcb1b, volume: fe3b80e9-97e2-4741-ab2f-20f2a22286c4, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8627dd3-e355-475e-bb3d-d903fc27c234]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:22 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b Apr 15 22:26:22 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:22 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b" returned: 0 in 0.509s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1691f17-d975-4358-b899-7fa64e8067e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ad48d-1d22-4951-8ef7-d249921dcb62]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:23 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 Apr 15 22:26:23 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:23 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5" returned: 0 in 0.593s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:23 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:26:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:23 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 Apr 15 22:26:23 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:25 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" returned: 0 in 2.257s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:25 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1439586-c95f-4418-a13d-3908a010b1f8]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:25 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 Apr 15 22:26:25 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:26 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5" returned: 0 in 0.660s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:26:26 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Converted 1024.00 MB image at 453.53 MB/s Apr 15 22:26:26 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 is being set with open permissions: ugo+rw Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:26 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 Apr 15 22:26:26 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:26 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" returned: 0 in 0.411s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" released by "_copy_volume_from_snapshot" :: held 4.484s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-c65f1ff1-b4a2-438c-8c39-e189136fcb1b" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-c65f1ff1-b4a2-438c-8c39-e189136fcb1b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Deleting offline snapshot c65f1ff1-b4a2-438c-8c39-e189136fcb1b of volume d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] snapshot_file for this snap is: volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae07c920-1524-45e7-b939-5977058a5a68]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:26 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b Apr 15 22:26:26 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:27 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b" returned: 0 in 0.538s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1691f17-d975-4358-b899-7fa64e8067e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:27 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb1978c-a76c-40c0-bc4b-d63c7865fbe6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:27 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 Apr 15 22:26:27 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:27 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5" returned: 0 in 0.553s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:28 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b Apr 15 22:26:28 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Flow 'volume_create_manager' (3a853765-fe84-41bc-8b26-837369878e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fac8542-be7c-47c3-b24e-b0d1177fd9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fac8542-be7c-47c3-b24e-b0d1177fd9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2060985473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8602eb-a916-4fe8-935c-885ecaba5302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304c3cf4ac1e47909a4a203379bead85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:28Z,use_quota=True,user_id='6cde3bb7c04947f082dd8559ca49b294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcf86f3-4c5e-48ca-a028-3cfa72ba915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bcf86f3-4c5e-48ca-a028-3cfa72ba915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d04659-77ea-4243-93ad-8147f68af609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d04659-77ea-4243-93ad-8147f68af609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc8602eb-a916-4fe8-935c-885ecaba5302', 'volume_name': 'volume-cc8602eb-a916-4fe8-935c-885ecaba5302', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca73f15-7576-41e7-b869-3499479db1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca73f15-7576-41e7-b869-3499479db1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687f739b-7da3-472b-9da4-cd996c9ba088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:28 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Volume cc8602eb-a916-4fe8-935c-885ecaba5302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc8602eb-a916-4fe8-935c-885ecaba5302', 'volume_size': 1} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:28 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:28 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b Apr 15 22:26:28 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:28 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5.c65f1ff1-b4a2-438c-8c39-e189136fcb1b" returned: 0 in 0.408s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-c65f1ff1-b4a2-438c-8c39-e189136fcb1b" released by "_delete_snapshot" :: held 2.042s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.831s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1353316585',display_name='tempest-VolumesGetTest-Volume-1613072421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a842a8c8-8d56-493b-be33-028ed5f5635b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d67cd09057904858988d1f5acc8f4e11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:20Z,use_quota=True,user_id='d27e279643104cbb9ee6f48f646dacd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Creating volume a842a8c8-8d56-493b-be33-028ed5f5635b {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:28 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682eded4-9f40-47df-9ef6-01fdd7750401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4', 'volume_size': 1, 'source_volid': 'd1691f17-d975-4358-b899-7fa64e8067e5', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:28 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b 1073741824 Apr 15 22:26:28 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb31e9f3-8326-48cc-bea6-bd277e594136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:28 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Volume volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 (fe3b80e9-97e2-4741-ab2f-20f2a22286c4): created successfully Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb31e9f3-8326-48cc-bea6-bd277e594136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:28 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Flow 'volume_create_manager' (8d236266-06b6-4936-9b62-e982671a15c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:28 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f165583f-3a32-4ae2-afc0-a837977a4528 tempest-VolumeDependencyTests-1128225397 None] Created volume successfully. Apr 15 22:26:29 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b 1073741824" returned: 0 in 0.512s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:29 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b Apr 15 22:26:29 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-d1691f17-d975-4358-b899-7fa64e8067e5-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-d1691f17-d975-4358-b899-7fa64e8067e5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-d1691f17-d975-4358-b899-7fa64e8067e5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-d1691f17-d975-4358-b899-7fa64e8067e5" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286e763-3591-4973-be23-1eef00efaa59]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:29 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 Apr 15 22:26:29 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:29 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b" returned: 0 in 0.423s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.280s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Creating offline snapshot 84a172c7-358a-4ec8-a0c1-15788b0a6bad of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493d8b5d-f9b7-4a4a-926a-58ba15232186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a842a8c8-8d56-493b-be33-028ed5f5635b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781ac37e-47ff-46d0-bc48-af78b2e26920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2672a1-c47a-4bf1-9bc1-b722f3f75b16]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:29 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Volume volume-a842a8c8-8d56-493b-be33-028ed5f5635b (a842a8c8-8d56-493b-be33-028ed5f5635b): created successfully Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781ac37e-47ff-46d0-bc48-af78b2e26920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Flow 'volume_create_manager' (36d95bb4-de4a-48ca-9b4d-bcd3fda1a26c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:29 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-554b92ed-740f-4784-ba0f-68a0a6d1408e tempest-VolumesGetTest-1533517202 None] Created volume successfully. Apr 15 22:26:30 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:30 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:30 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5" returned: 0 in 0.470s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:30 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5 Apr 15 22:26:30 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:30 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:30 devstack sudo[88806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad 1G Apr 15 22:26:30 devstack sudo[88806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:30 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d1691f17-d975-4358-b899-7fa64e8067e5" returned: 0 in 0.443s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-d1691f17-d975-4358-b899-7fa64e8067e5" released by "delete_volume" :: held 0.949s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Created reservations ['d2b7df31-76f9-4813-b9cf-5966d244b436', 'ce3db08b-7738-4444-9a46-384dff2637b1', '2c571b31-2221-4b13-8ca6-79a43901f372', '2a65a84d-054b-4124-a70f-c236d171612e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-a842a8c8-8d56-493b-be33-028ed5f5635b-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Lock "cinder-a842a8c8-8d56-493b-be33-028ed5f5635b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-a842a8c8-8d56-493b-be33-028ed5f5635b" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-a842a8c8-8d56-493b-be33-028ed5f5635b" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[23343fa7-cb6d-42e9-963f-a313d650e736]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-fe3b80e9-97e2-4741-ab2f-20f2a22286c4-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:30 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:30 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-fe3b80e9-97e2-4741-ab2f-20f2a22286c4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b1acf6-c5e1-4121-a6b7-f0a16e30bc56]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:30 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b Apr 15 22:26:30 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:30 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 Apr 15 22:26:30 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:30 devstack sudo[88806]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad 1G" returned: 0 in 0.536s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:30 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad Apr 15 22:26:30 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:31 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.429s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:31 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Deleted volume successfully. Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-52f2d96d-983e-48a6-a754-789188bc4742 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-d1691f17-d975-4358-b899-7fa64e8067e5-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:31 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b" returned: 0 in 0.541s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:31 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b Apr 15 22:26:31 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:31 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" returned: 0 in 0.548s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:31 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4 Apr 15 22:26:31 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:31 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad" returned: 0 in 0.448s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:31 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad is being set with open permissions: ugo+rw Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:31 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad Apr 15 22:26:31 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:31 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a842a8c8-8d56-493b-be33-028ed5f5635b" returned: 0 in 0.434s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-a842a8c8-8d56-493b-be33-028ed5f5635b" released by "delete_volume" :: held 0.998s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Created reservations ['33e2d157-4284-43dd-a86f-d4060560b048', '93848313-b328-4f46-b374-a3085e0d6d25', 'c9db5f5f-0a32-4cf5-ab41-1729dc6abd54', '32536fca-a0ea-4570-9727-205271b79e91'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:31 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:31 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:31 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-fe3b80e9-97e2-4741-ab2f-20f2a22286c4" released by "delete_volume" :: held 1.028s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:31 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad" returned: 0 in 0.438s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.471s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2060985473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc8602eb-a916-4fe8-935c-885ecaba5302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304c3cf4ac1e47909a4a203379bead85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:28Z,use_quota=True,user_id='6cde3bb7c04947f082dd8559ca49b294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Creating volume cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:31 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:31 devstack sudo[88841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 1073741824 Apr 15 22:26:31 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:31 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9a34be78-e58c-47dc-adc2-272fd03c370e tempest-SnapshotsActionsTest-1720222433 None] Create snapshot completed successfully Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Created reservations ['3c0905f0-0c40-4045-93de-37079aaf5449', '33b9df80-2c9a-4eac-bc70-09e9750f9126', 'cb67480f-5325-4ba2-8412-51c46cad1e12', '21fb1fd7-59d7-4fa2-bc56-4efc2f8604eb'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:31 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:31 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-84a172c7-358a-4ec8-a0c1-15788b0a6bad-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-84a172c7-358a-4ec8-a0c1-15788b0a6bad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-84a172c7-358a-4ec8-a0c1-15788b0a6bad" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-84a172c7-358a-4ec8-a0c1-15788b0a6bad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Deleting offline snapshot 84a172c7-358a-4ec8-a0c1-15788b0a6bad of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] snapshot_file for this snap is: volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a0c391-6ce5-4d5d-be82-592e76b41a20]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:32 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad Apr 15 22:26:32 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:32 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.486s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:32 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Deleted volume successfully. Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-75ca79f2-a8f2-47a8-946a-b3bc9c1114d3 tempest-VolumesGetTest-1533517202 None] Lock "cinder-a842a8c8-8d56-493b-be33-028ed5f5635b-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:32 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 1073741824" returned: 0 in 0.507s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:32 devstack sudo[88853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 Apr 15 22:26:32 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:32 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.546s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:32 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Deleted volume successfully. Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8413d9c-1375-4dda-a321-4fc09c50a132 tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-fe3b80e9-97e2-4741-ab2f-20f2a22286c4-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:32 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad" returned: 0 in 0.507s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce872a02-a81c-409b-a84a-4570a7fbb360]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:32 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:32 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:32 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302" returned: 0 in 0.414s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687f739b-7da3-472b-9da4-cd996c9ba088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc8602eb-a916-4fe8-935c-885ecaba5302', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106f251-e003-42af-823c-b51ecda2fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:32 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Volume volume-cc8602eb-a916-4fe8-935c-885ecaba5302 (cc8602eb-a916-4fe8-935c-885ecaba5302): created successfully Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7106f251-e003-42af-823c-b51ecda2fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Flow 'volume_create_manager' (3a853765-fe84-41bc-8b26-837369878e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:32 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d24032f9-4b09-4d70-aebb-0c12ea2a1734 tempest-SnapshotDependencyTests-310641816 None] Created volume successfully. Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-da95f7f6-a43d-4cc2-9408-8752beb58981-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Lock "cinder-da95f7f6-a43d-4cc2-9408-8752beb58981-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Acquiring lock "cinder-quobyte-da95f7f6-a43d-4cc2-9408-8752beb58981" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-da95f7f6-a43d-4cc2-9408-8752beb58981" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdaf426-96ba-4c2d-9e61-b64f25e2691e]: (4, 'raw') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-23174ee4-d8bf-4afb-b452-3808d6a5bfcf-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-23174ee4-d8bf-4afb-b452-3808d6a5bfcf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "cinder-quobyte-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2431eac3-c452-408d-bdc1-7cda1d92c9ed]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:33 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 Apr 15 22:26:33 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:33 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf Apr 15 22:26:33 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:33 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.580s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:33 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad Apr 15 22:26:33 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:33 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981" returned: 0 in 0.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:33 devstack sudo[88875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 Apr 15 22:26:33 devstack sudo[88875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:33 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" returned: 0 in 0.556s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:33 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf Apr 15 22:26:33 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Creating offline snapshot 8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 of volume cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bccc3d5-5f41-41d0-8dd1-9c108b8522a9]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:33 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad" returned: 0 in 0.561s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:33 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad Apr 15 22:26:33 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:33 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 Apr 15 22:26:33 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:34 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" returned: 0 in 0.417s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-quobyte-23174ee4-d8bf-4afb-b452-3808d6a5bfcf" released by "delete_volume" :: held 0.995s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Created reservations ['c750057b-8ea3-4794-8346-2ea7cd7992ea', 'efb94be2-2851-41d6-bc70-562598da8c81', 'edccddf8-6fef-417a-92c0-8af3b1a19f25', 'd229ec28-bcc0-4d66-9a02-f5c1ffc58433'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:34 devstack sudo[88875]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981" returned: 1 in 0.609s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981' failed. Not Retrying. {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:34 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981 Apr 15 22:26:34 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:34 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:34 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:34 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.84a172c7-358a-4ec8-a0c1-15788b0a6bad" returned: 0 in 0.473s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-84a172c7-358a-4ec8-a0c1-15788b0a6bad" released by "_delete_snapshot" :: held 2.175s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" released by "delete_snapshot" :: held 2.193s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:34 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302" returned: 0 in 0.533s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:34 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 1G Apr 15 22:26:34 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Created reservations ['941d8e23-b0f5-44f8-bb55-7d52509115e0', '115edf3f-98b5-43e4-b15f-0ee6d0c4629b', '3d7bda49-ac73-4411-80f6-942eb32b745f', 'e5be39cd-b01a-45e2-8f91-25fe8676d97e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:34 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Delete snapshot completed successfully. Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3c72ce3d-aba5-44e7-b7dd-acc0655d0732 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-84a172c7-358a-4ec8-a0c1-15788b0a6bad-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:34 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.424s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:34 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:34 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Deleted volume successfully. Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-da95f7f6-a43d-4cc2-9408-8752beb58981" returned: 0 in 0.459s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Lock "cinder-quobyte-da95f7f6-a43d-4cc2-9408-8752beb58981" released by "delete_volume" :: held 1.680s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d3af6f6-5d91-4bd9-80ef-596969b1c50b tempest-VolumeDependencyTests-1128225397 None] Lock "cinder-23174ee4-d8bf-4afb-b452-3808d6a5bfcf-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Created reservations ['7c5bf982-1123-4dc3-a6a8-673c6ef8c0e3', 'b1ed6567-8c86-483e-ad22-e24f860223fa', 'e8159cde-25fe-4354-b7f7-c8a2f2faa493', '7b21d0b6-73c2-4de4-b310-2766d9c320e8'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:34 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:34 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:34 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 1G" returned: 0 in 0.527s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8602eb-a916-4fe8-935c-885ecaba5302 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:34 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8602eb-a916-4fe8-935c-885ecaba5302 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 Apr 15 22:26:34 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:35 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.495s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:35 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Deleted volume successfully. Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2ec07973-1185-4734-9647-2c24bbedd4ba tempest-VolumesGetTest-1533517202 None] Lock "cinder-da95f7f6-a43d-4cc2-9408-8752beb58981-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:35 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc8602eb-a916-4fe8-935c-885ecaba5302 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" returned: 0 in 0.493s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:35 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 is being set with open permissions: ugo+rw Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:35 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 Apr 15 22:26:35 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:35 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" returned: 0 in 0.555s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:35 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.info Apr 15 22:26:35 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:36 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.info" returned: 0 in 0.556s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:36 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.info is being set with open permissions: ugo+rw Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:36 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.info Apr 15 22:26:36 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:36 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.info" returned: 0 in 0.457s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.453s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=265,cinder:SELECT=205,cinder:DELETE=23,cinder:INSERT=74 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=208,cinder:UPDATE=294,cinder:INSERT=75,cinder:DELETE=24 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:26:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Creating offline snapshot a6e58796-66a5-4ab5-afeb-2e7db2a64b82 of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9eae45e8-cfeb-47cc-9fef-350377a71800 tempest-SnapshotDependencyTests-310641816 None] Create snapshot completed successfully Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed064c-3d67-479e-bfc8-339c21b302be]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:37 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:37 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Flow 'volume_create_manager' (5a916a6c-1838-4506-8e53-20a51febfaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fc3f05-b4e5-4a87-ac06-18f4a0c7222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fc3f05-b4e5-4a87-ac06-18f4a0c7222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1750774246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aac2cbb-8d33-477d-8c4b-6e6de09f9933,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491c454c95de48cdabcb0781cdfccb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:37Z,use_quota=True,user_id='25a65b8c511c41508f305befd1bb9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c89795-1d6c-48cb-b687-f7abd43545ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c89795-1d6c-48cb-b687-f7abd43545ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd4fa02-ad95-4ee7-bd92-a03e929aa36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd4fa02-ad95-4ee7-bd92-a03e929aa36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aac2cbb-8d33-477d-8c4b-6e6de09f9933', 'volume_name': 'volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0057a9c0-84c3-450c-b445-2375f08da231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0057a9c0-84c3-450c-b445-2375f08da231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129562d0-4650-430a-a65f-f0c7fe6c34f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:37 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Volume 3aac2cbb-8d33-477d-8c4b-6e6de09f9933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933', 'volume_size': 1} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:37 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.505s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:37 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 1G Apr 15 22:26:37 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:38 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 1G" returned: 0 in 0.522s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:38 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 Apr 15 22:26:38 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Flow 'volume_create_manager' (7abd6ee5-2a16-4643-a7f5-e5eccdbb02ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3da59b-b517-4ac4-800e-4aa3af858310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3da59b-b517-4ac4-800e-4aa3af858310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c46ed0b3-cd5a-4418-99cc-f16c22bfaf47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304c3cf4ac1e47909a4a203379bead85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:38Z,use_quota=True,user_id='6cde3bb7c04947f082dd8559ca49b294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2efec1-7f08-46ba-beff-6e37d3a7ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2efec1-7f08-46ba-beff-6e37d3a7ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730db065-9953-41bf-a60b-667f39e6da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730db065-9953-41bf-a60b-667f39e6da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c46ed0b3-cd5a-4418-99cc-f16c22bfaf47', 'volume_name': 'volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47', 'volume_size': 1, 'snapshot_id': '8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065e7185-a080-4421-9d21-8d3fe25ebd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065e7185-a080-4421-9d21-8d3fe25ebd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df2383c-e69a-4794-b416-74604496ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:38 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Volume c46ed0b3-cd5a-4418-99cc-f16c22bfaf47: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47', 'volume_size': 1, 'snapshot_id': '8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3'} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:38 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82" returned: 0 in 0.475s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:38 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 is being set with open permissions: ugo+rw Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:38 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 Apr 15 22:26:38 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:38 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82" returned: 0 in 0.432s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1750774246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aac2cbb-8d33-477d-8c4b-6e6de09f9933,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491c454c95de48cdabcb0781cdfccb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:37Z,use_quota=True,user_id='25a65b8c511c41508f305befd1bb9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Creating volume 3aac2cbb-8d33-477d-8c4b-6e6de09f9933 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:38 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:39 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 1073741824 Apr 15 22:26:39 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d81d3065-6304-4f14-bc18-5a3db48bb13c tempest-SnapshotsActionsTest-1720222433 None] Create snapshot completed successfully Apr 15 22:26:39 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 1073741824" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:39 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 Apr 15 22:26:39 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-a6e58796-66a5-4ab5-afeb-2e7db2a64b82-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-a6e58796-66a5-4ab5-afeb-2e7db2a64b82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-a6e58796-66a5-4ab5-afeb-2e7db2a64b82" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-a6e58796-66a5-4ab5-afeb-2e7db2a64b82" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Deleting offline snapshot a6e58796-66a5-4ab5-afeb-2e7db2a64b82 of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] snapshot_file for this snap is: volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb031b-1885-4f4b-b3bb-28d9b2b9cc32]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:39 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 Apr 15 22:26:39 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:39 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.603s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-quobyte-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Creating volume c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 from snapshot 8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-quobyte-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129562d0-4650-430a-a65f-f0c7fe6c34f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:39 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4b0385-f43d-43b3-a199-1128e6b54488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Volume volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 (3aac2cbb-8d33-477d-8c4b-6e6de09f9933): created successfully Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4b0385-f43d-43b3-a199-1128e6b54488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Flow 'volume_create_manager' (5a916a6c-1838-4506-8e53-20a51febfaa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] snapshot: 8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3, volume: c46ed0b3-cd5a-4418-99cc-f16c22bfaf47, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:26:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-484baec0-7460-4f9c-9339-792e5ee9c83f tempest-VolumesListTestJSON-1035185790 None] Created volume successfully. Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bd61b7-4f22-4b73-b9cc-6127ca5f51da]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:40 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 Apr 15 22:26:40 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:40 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82" returned: 0 in 0.514s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99f93e5-dff6-4848-970b-ba7027a8fdad]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:40 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:40 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Flow 'volume_create_manager' (c30d99a6-5df0-4dc0-ac76-3bcb38d0f479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3bb4b3-7c81-43f8-ac34-4af532b2dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3bb4b3-7c81-43f8-ac34-4af532b2dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-357555579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173f8d10-e346-484d-807a-c0283445cddb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491c454c95de48cdabcb0781cdfccb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:41Z,use_quota=True,user_id='25a65b8c511c41508f305befd1bb9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f8f25c-0772-4b62-aeb0-9946609664bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f8f25c-0772-4b62-aeb0-9946609664bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:40 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f02787-733e-4a67-a572-89b64ca41274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f02787-733e-4a67-a572-89b64ca41274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173f8d10-e346-484d-807a-c0283445cddb', 'volume_name': 'volume-173f8d10-e346-484d-807a-c0283445cddb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6348b03-2031-4de7-b61f-7f896c3747a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6348b03-2031-4de7-b61f-7f896c3747a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8eaccc-f7bd-4bff-957e-7c79c668bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Volume 173f8d10-e346-484d-807a-c0283445cddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173f8d10-e346-484d-807a-c0283445cddb', 'volume_size': 1} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" returned: 0 in 0.583s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8602eb-a916-4fe8-935c-885ecaba5302(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b92008-49bc-4cf1-844c-c3096f2abeb9]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:40 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 Apr 15 22:26:40 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:40 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.519s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:40 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 Apr 15 22:26:40 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:41 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302" returned: 0 in 0.482s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:41 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:26:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:41 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 Apr 15 22:26:41 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:41 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:41 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82 Apr 15 22:26:41 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:42 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.a6e58796-66a5-4ab5-afeb-2e7db2a64b82" returned: 0 in 0.801s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-a6e58796-66a5-4ab5-afeb-2e7db2a64b82" released by "_delete_snapshot" :: held 2.382s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" released by "delete_snapshot" :: held 2.398s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:42 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Created reservations ['bf5cc7bd-507e-44aa-9cb8-3c74a3e681d8', '0a5896ac-969e-48d3-9c1f-211b34e501fa', 'b464376f-7874-4d12-b632-f7c521436afa', 'b5758fa7-8a6f-4b7e-861e-5cde3c7c25fc'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Delete snapshot completed successfully. Apr 15 22:26:42 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-82bbdd11-8379-4bd7-8285-4f84c74ff794 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-a6e58796-66a5-4ab5-afeb-2e7db2a64b82-delete_snapshot" released by "delete_snapshot" :: held 2.648s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:43 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" returned: 0 in 2.232s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:43 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57b089d-fc51-49d8-b22f-81f539582e68]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:43 devstack sudo[88991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 Apr 15 22:26:43 devstack sudo[88991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:43 devstack sudo[88991]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302" returned: 0 in 0.614s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:43 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:26:43 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Converted 1024.00 MB image at 458.67 MB/s Apr 15 22:26:43 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 is being set with open permissions: ugo+rw Apr 15 22:26:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:44 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 Apr 15 22:26:44 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:44 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" returned: 0 in 0.405s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" released by "_copy_volume_from_snapshot" :: held 4.378s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" released by "_create_volume_from_snapshot" :: held 4.424s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.436s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.779s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-357555579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173f8d10-e346-484d-807a-c0283445cddb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491c454c95de48cdabcb0781cdfccb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:41Z,use_quota=True,user_id='25a65b8c511c41508f305befd1bb9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Creating volume 173f8d10-e346-484d-807a-c0283445cddb {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:44 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:44 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb 1073741824 Apr 15 22:26:44 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6df2383c-e69a-4794-b416-74604496ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47', 'volume_size': 1, 'snapshot_id': '8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1273d9-55b3-45ea-be88-22e3bb4accae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Volume volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 (c46ed0b3-cd5a-4418-99cc-f16c22bfaf47): created successfully Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc1273d9-55b3-45ea-be88-22e3bb4accae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Flow 'volume_create_manager' (7abd6ee5-2a16-4643-a7f5-e5eccdbb02ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:44 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-33e4a6cb-4d9a-46c7-aef4-6b39b5555cfe tempest-SnapshotDependencyTests-310641816 None] Created volume successfully. Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-quobyte-cc8602eb-a916-4fe8-935c-885ecaba5302" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-cc8602eb-a916-4fe8-935c-885ecaba5302" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-quobyte-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Deleting offline snapshot 8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 of volume cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] snapshot_file for this snap is: volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1df08-8ed6-4a12-a1e9-2086b7901b16]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:44 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 Apr 15 22:26:44 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:44 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb 1073741824" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:44 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb Apr 15 22:26:44 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:45 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" returned: 0 in 0.488s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc8602eb-a916-4fe8-935c-885ecaba5302(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca08ad8-da65-4b99-926b-91b3df31bd22]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:45 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 Apr 15 22:26:45 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:45 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb" returned: 0 in 0.411s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.978s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8eaccc-f7bd-4bff-957e-7c79c668bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173f8d10-e346-484d-807a-c0283445cddb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c5f9b9-8832-4d99-9522-904c738c0f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Creating offline snapshot 00cc19cd-4633-47dc-95ed-ac7f1533b2a7 of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:26:45 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Volume volume-173f8d10-e346-484d-807a-c0283445cddb (173f8d10-e346-484d-807a-c0283445cddb): created successfully Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c5f9b9-8832-4d99-9522-904c738c0f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Flow 'volume_create_manager' (c30d99a6-5df0-4dc0-ac76-3bcb38d0f479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c5a83-397f-4d0a-958b-7945663a6742]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-db6b7636-ac25-45fb-b1e1-6621ed4c09a4 tempest-VolumesListTestJSON-1035185790 None] Created volume successfully. Apr 15 22:26:45 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:45 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:45 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302" returned: 0 in 0.494s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:45 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 Apr 15 22:26:45 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:45 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.504s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:45 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 1G Apr 15 22:26:45 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Flow 'volume_create_manager' (fa6c6e98-a585-4e4e-b479-a297a4d30be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bb8d57-e018-4351-ad8f-a113e533069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bb8d57-e018-4351-ad8f-a113e533069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1331364269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effc591d-db20-4e58-8958-3575ce51c0ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491c454c95de48cdabcb0781cdfccb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:46Z,use_quota=True,user_id='25a65b8c511c41508f305befd1bb9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3aefa5-393b-454b-9a2a-a6893b4b9aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3aefa5-393b-454b-9a2a-a6893b4b9aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c00afb4-6475-42dd-9694-49c61840872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c00afb4-6475-42dd-9694-49c61840872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effc591d-db20-4e58-8958-3575ce51c0ab', 'volume_name': 'volume-effc591d-db20-4e58-8958-3575ce51c0ab', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37554b7b-79f8-4ea2-8a92-7bd6d3ee4a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37554b7b-79f8-4ea2-8a92-7bd6d3ee4a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52185524-c715-483f-8b2e-9e8f93411331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:46 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Volume effc591d-db20-4e58-8958-3575ce51c0ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effc591d-db20-4e58-8958-3575ce51c0ab', 'volume_size': 1} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:46 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" returned: 0 in 0.493s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:46 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3 Apr 15 22:26:46 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:46 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 1G" returned: 0 in 0.522s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:46 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 Apr 15 22:26:46 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:46 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302.8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" returned: 0 in 0.428s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3" released by "_delete_snapshot" :: held 1.963s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-cc8602eb-a916-4fe8-935c-885ecaba5302" released by "delete_snapshot" :: held 1.980s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Created reservations ['a6d704bb-d64f-41d1-a23c-5aeb407cc9ee', 'b33fb059-f949-4a6b-aa75-a3281a4124b5', 'a4a38580-3902-4526-8ccc-fc541c311b0a', '495d495f-2621-426e-9041-2fb6891c8524'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:46 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Delete snapshot completed successfully. Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-745fb8eb-fd09-49d9-8929-7e043d0e1029 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-8cd8ca54-eace-4f02-a5ce-3d7aad7d54c3-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-cc8602eb-a916-4fe8-935c-885ecaba5302-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-cc8602eb-a916-4fe8-935c-885ecaba5302-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-quobyte-cc8602eb-a916-4fe8-935c-885ecaba5302" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-cc8602eb-a916-4fe8-935c-885ecaba5302" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c685de-8d0a-40ec-8fda-7f333565c181]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:46 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7" returned: 0 in 0.491s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:46 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 is being set with open permissions: ugo+rw Apr 15 22:26:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:46 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 Apr 15 22:26:46 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:47 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 Apr 15 22:26:47 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:47 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7" returned: 0 in 0.415s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.148s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1331364269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effc591d-db20-4e58-8958-3575ce51c0ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='491c454c95de48cdabcb0781cdfccb72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:26:46Z,use_quota=True,user_id='25a65b8c511c41508f305befd1bb9915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Creating volume effc591d-db20-4e58-8958-3575ce51c0ab {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:47 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:47 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:47 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab 1073741824 Apr 15 22:26:47 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302" returned: 0 in 0.488s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:47 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2378d802-f5e9-449d-be88-b8f0694f52ba tempest-SnapshotsActionsTest-1720222433 None] Create snapshot completed successfully Apr 15 22:26:47 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302 Apr 15 22:26:47 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-00cc19cd-4633-47dc-95ed-ac7f1533b2a7-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-00cc19cd-4633-47dc-95ed-ac7f1533b2a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Acquiring lock "cinder-quobyte-00cc19cd-4633-47dc-95ed-ac7f1533b2a7" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-00cc19cd-4633-47dc-95ed-ac7f1533b2a7" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Deleting offline snapshot 00cc19cd-4633-47dc-95ed-ac7f1533b2a7 of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] snapshot_file for this snap is: volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77aac70-22af-44d7-86d9-90afe2e9445d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:47 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 Apr 15 22:26:47 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:47 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab 1073741824" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:47 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cc8602eb-a916-4fe8-935c-885ecaba5302" returned: 0 in 0.464s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-cc8602eb-a916-4fe8-935c-885ecaba5302" released by "delete_volume" :: held 0.997s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:47 devstack sudo[89058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab Apr 15 22:26:47 devstack sudo[89058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Created reservations ['d9321b58-f146-427b-94f7-943fe8af6f55', '2f3e658c-d633-47f0-9958-ac1dd1736e81', '8f58b8fc-1e17-4150-b368-4388a57296b6', '5bf2258f-769e-4b6f-b597-1dbcd763f5ea'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:48 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:48 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:48 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7" returned: 0 in 0.529s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c091af-3f8b-459f-85ee-20554950cd1b]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:48 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:48 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:48 devstack sudo[89058]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab" returned: 0 in 0.425s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52185524-c715-483f-8b2e-9e8f93411331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effc591d-db20-4e58-8958-3575ce51c0ab', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d658e8-5c77-417c-8709-bca7469b6aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:48 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Volume volume-effc591d-db20-4e58-8958-3575ce51c0ab (effc591d-db20-4e58-8958-3575ce51c0ab): created successfully Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d658e8-5c77-417c-8709-bca7469b6aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Flow 'volume_create_manager' (fa6c6e98-a585-4e4e-b479-a297a4d30be0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:48 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f929972f-7c08-465a-8e4e-8ddc89c09334 tempest-VolumesListTestJSON-1035185790 None] Created volume successfully. Apr 15 22:26:48 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.434s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:48 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Deleted volume successfully. Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13520098-855d-43b8-80b0-fa284b15aebe tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-cc8602eb-a916-4fe8-935c-885ecaba5302-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:48 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:48 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 Apr 15 22:26:48 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "cinder-quobyte-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30d311c-aac7-4f3e-b902-706dbecdb387]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:49 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7" returned: 0 in 0.502s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:49 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7 Apr 15 22:26:49 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:49 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 Apr 15 22:26:49 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:49 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" returned: 0 in 0.468s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:49 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47 Apr 15 22:26:49 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:49 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.00cc19cd-4633-47dc-95ed-ac7f1533b2a7" returned: 0 in 0.454s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-00cc19cd-4633-47dc-95ed-ac7f1533b2a7" released by "_delete_snapshot" :: held 2.024s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" released by "delete_snapshot" :: held 2.035s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Created reservations ['cdfb5fff-0ddd-4776-98e2-eae1228990c0', '07afa47b-8ca0-45e8-8628-a380ed51a112', 'c10fd4be-2d74-4aec-9a37-1ebb1939bbeb', '6edcbd90-e96f-46ed-a4f4-ac2d2c568ecf'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:49 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Delete snapshot completed successfully. Apr 15 22:26:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-531a506c-ac86-401f-b85f-c97f44ebaca7 tempest-SnapshotsActionsTest-877777943 None] Lock "cinder-00cc19cd-4633-47dc-95ed-ac7f1533b2a7-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:50 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" returned: 0 in 0.447s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-quobyte-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47" released by "delete_volume" :: held 0.938s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Created reservations ['19dc3746-5e8c-4a71-8216-4cb396a2f1f8', 'a34cfcb8-490b-4864-ae81-69b16e1d96c6', '38ea8dba-d103-467b-a65e-1b94b042f131', '58a35e2a-303a-401b-be8c-7771a32741f2'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:50 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:50 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:50 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.495s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:50 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Deleted volume successfully. Apr 15 22:26:50 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9428f241-47f8-48fc-972b-7f9bae35c876 tempest-SnapshotDependencyTests-310641816 None] Lock "cinder-c46ed0b3-cd5a-4418-99cc-f16c22bfaf47-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "cinder-c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "cinder-quobyte-c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-quobyte-c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Deleting offline snapshot c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 of volume d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] snapshot_file for this snap is: volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf38fa-95f5-494e-a4f0-ab59e670edc0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:51 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:51 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "cinder-effc591d-db20-4e58-8958-3575ce51c0ab-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-effc591d-db20-4e58-8958-3575ce51c0ab-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "cinder-quobyte-effc591d-db20-4e58-8958-3575ce51c0ab" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-quobyte-effc591d-db20-4e58-8958-3575ce51c0ab" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[812f1af9-1ded-4129-b7bc-9bd216a68a3f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:51 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab Apr 15 22:26:51 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:51 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.542s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de80811-c4bd-4069-8799-e240b53c6c3a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:51 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb Apr 15 22:26:51 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:51 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab" returned: 0 in 0.504s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:51 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab Apr 15 22:26:51 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:52 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb" returned: 0 in 0.561s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:52 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:52 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:52 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-effc591d-db20-4e58-8958-3575ce51c0ab" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-quobyte-effc591d-db20-4e58-8958-3575ce51c0ab" released by "delete_volume" :: held 1.016s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Created reservations ['f3b69cc5-52f4-4471-89ba-391191e910e7', 'd13be304-ebfe-4a92-959a-43ee26618670', '0dc2afed-7852-424b-b3cb-5dbde018039d', '7e85a666-fb4c-4fd2-8a26-6712eabf0a67'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:52 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:52 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:52 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.541s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:52 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249 Apr 15 22:26:52 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:53 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.510s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Deleted volume successfully. Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dfed5768-daad-4c48-ae30-92c73d4f0aee tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-effc591d-db20-4e58-8958-3575ce51c0ab-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:53 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb.c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" returned: 0 in 0.541s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-quobyte-c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249" released by "_delete_snapshot" :: held 2.248s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" released by "delete_snapshot" :: held 2.259s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Created reservations ['5358d0e1-31f6-4e3b-9eb4-90929bf3af40', '826e5803-70bc-48b0-b8f1-9fdcac72505d', '0e4d8b98-c5a3-44ae-8d09-41e917227339', '8a265ffd-35a1-4b57-a31d-6f4a2e67086c'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Delete snapshot completed successfully. Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c4a7411-240d-4ff3-aac7-4982d9d32626 tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-c8a5fcd1-15a7-4b9f-9b1d-c5eaca1e3249-delete_snapshot" released by "delete_snapshot" :: held 2.370s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "cinder-173f8d10-e346-484d-807a-c0283445cddb-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-173f8d10-e346-484d-807a-c0283445cddb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "cinder-quobyte-173f8d10-e346-484d-807a-c0283445cddb" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-quobyte-173f8d10-e346-484d-807a-c0283445cddb" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[be284acc-251c-4c49-ab86-8f480a528fdb]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:53 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb Apr 15 22:26:53 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:54 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb" returned: 0 in 0.503s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:54 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb Apr 15 22:26:54 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "cinder-d49bd518-bb00-4d0b-ae46-c55be739f3bb-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-d49bd518-bb00-4d0b-ae46-c55be739f3bb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f366c15-6675-4066-a5c9-c3ad0dedb5b7]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:54 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb Apr 15 22:26:54 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:54 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-173f8d10-e346-484d-807a-c0283445cddb" returned: 0 in 0.470s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-quobyte-173f8d10-e346-484d-807a-c0283445cddb" released by "delete_volume" :: held 0.997s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Created reservations ['cc996b62-37f5-491d-92b6-9baf8f2fd4ac', '517b4915-0c6b-4a73-9425-3f7e74ff6000', '948cfb75-1c40-42c7-8493-726047cfce21', '4aff81bf-eedf-4ce8-a172-daf43b9660df'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:54 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:54 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:54 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb" returned: 0 in 0.522s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:54 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb Apr 15 22:26:54 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:55 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.436s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Deleted volume successfully. Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a49c4b17-46df-44b6-90da-4fdf3dce22ab tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-173f8d10-e346-484d-807a-c0283445cddb-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:55 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d49bd518-bb00-4d0b-ae46-c55be739f3bb" returned: 0 in 0.495s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-quobyte-d49bd518-bb00-4d0b-ae46-c55be739f3bb" released by "delete_volume" :: held 1.069s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Created reservations ['e4b13036-9dc5-4c4a-a766-e9f2bc0a298f', 'a09374b4-cf8b-458c-a1e1-1a052f4f526c', 'ea141aed-fefe-4789-a6c3-005de74de5ce', 'ba4bceda-7624-4a74-98f2-1dd9dfd87c2d'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:55 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:55 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "cinder-3aac2cbb-8d33-477d-8c4b-6e6de09f9933-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-3aac2cbb-8d33-477d-8c4b-6e6de09f9933-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "cinder-quobyte-3aac2cbb-8d33-477d-8c4b-6e6de09f9933" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-quobyte-3aac2cbb-8d33-477d-8c4b-6e6de09f9933" acquired by "delete_volume" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[899eb6aa-d3c4-423e-b935-47a362818820]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:26:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:55 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 Apr 15 22:26:55 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:56 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.515s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:56 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:56 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Deleted volume successfully. Apr 15 22:26:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ef8c641e-1ff0-442d-97a5-e24b7c863c1d tempest-SnapshotsActionsTest-1720222433 None] Lock "cinder-d49bd518-bb00-4d0b-ae46-c55be739f3bb-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:56 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933" returned: 0 in 0.544s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:56 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933 Apr 15 22:26:56 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:56 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3aac2cbb-8d33-477d-8c4b-6e6de09f9933" returned: 0 in 0.477s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-quobyte-3aac2cbb-8d33-477d-8c4b-6e6de09f9933" released by "delete_volume" :: held 1.047s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Created reservations ['b5165e48-efed-4d8f-8d60-19e982ba29eb', '456fda40-d87f-4ce8-bb43-36d8e833b847', '619d1c7b-09c0-4ccf-863f-141137fd544e', '3544c83f-da7b-4c71-8821-057f3ac30c07'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:57 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:26:57 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:26:57 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.459s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:26:57 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Deleted volume successfully. Apr 15 22:26:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a2bdaa47-e418-4e79-8223-bd866744a0d1 tempest-VolumesListTestJSON-1035185790 None] Lock "cinder-3aac2cbb-8d33-477d-8c4b-6e6de09f9933-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (eba18f4b-2137-4d0d-a8f1-9edd7a6f229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac32fc56-74c9-4ed0-9c5b-a18a240c8db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac32fc56-74c9-4ed0-9c5b-a18a240c8db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651211526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1662b4b2-5935-4c79-8229-60dc9f039ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:00Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7fc1d1-8cec-4698-8b08-cddbdfe1e3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7fc1d1-8cec-4698-8b08-cddbdfe1e3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e32af86-b1f8-4b23-ad30-7692280c0263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e32af86-b1f8-4b23-ad30-7692280c0263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1662b4b2-5935-4c79-8229-60dc9f039ade', 'volume_name': 'volume-1662b4b2-5935-4c79-8229-60dc9f039ade', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d3cffd-3792-4a13-afbc-515228438394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d3cffd-3792-4a13-afbc-515228438394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499c0e76-8668-4774-a55d-43a9b24da1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:26:59 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume 1662b4b2-5935-4c79-8229-60dc9f039ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1662b4b2-5935-4c79-8229-60dc9f039ade', 'volume_size': 1} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-651211526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1662b4b2-5935-4c79-8229-60dc9f039ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:00Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Creating volume 1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:26:59 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:26:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:26:59 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade 1073741824 Apr 15 22:26:59 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:00 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade 1073741824" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:00 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade Apr 15 22:27:00 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:00 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade" returned: 0 in 0.505s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:00 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499c0e76-8668-4774-a55d-43a9b24da1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1662b4b2-5935-4c79-8229-60dc9f039ade', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:00 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f859617d-b57b-449c-aed3-f198e1133b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:00 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume volume-1662b4b2-5935-4c79-8229-60dc9f039ade (1662b4b2-5935-4c79-8229-60dc9f039ade): created successfully Apr 15 22:27:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f859617d-b57b-449c-aed3-f198e1133b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (eba18f4b-2137-4d0d-a8f1-9edd7a6f229e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:01 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-db03a40b-00d7-435a-be2f-14e7f1fe2df5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created volume successfully. Apr 15 22:27:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Creating offline snapshot 9b4b00fc-d5b2-49f2-b250-4d64677a54f9 of volume 1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:27:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccb1d71-e50b-4dc8-8483-23aad0e119db]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:02 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade Apr 15 22:27:02 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:02 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade" returned: 0 in 0.554s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:02 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 1G Apr 15 22:27:02 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Flow 'volume_create_manager' (049f74a6-759d-4ac1-a261-232fe612d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594fea8-4c1f-46e5-a861-3edee3d23b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594fea8-4c1f-46e5-a861-3edee3d23b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-653624902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80876fae-e625-4fce-ae1f-a9d2da84450e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938751c2b9f54d38bee656e00893cb6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:03Z,use_quota=True,user_id='d330fedcf61c4ac3b7fca2a301f58819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8546bd8f-347a-45a4-913f-96c09481b0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8546bd8f-347a-45a4-913f-96c09481b0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af74ed3a-aad8-43dc-9af6-597b0859f001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af74ed3a-aad8-43dc-9af6-597b0859f001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80876fae-e625-4fce-ae1f-a9d2da84450e', 'volume_name': 'volume-80876fae-e625-4fce-ae1f-a9d2da84450e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2649caf-9b30-4f13-bf72-8ac6de293967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2649caf-9b30-4f13-bf72-8ac6de293967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7c34df-8d09-47c9-b847-91f39d89e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:03 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Volume 80876fae-e625-4fce-ae1f-a9d2da84450e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80876fae-e625-4fce-ae1f-a9d2da84450e', 'volume_size': 1} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:03 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 1G" returned: 0 in 0.570s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1662b4b2-5935-4c79-8229-60dc9f039ade -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:03 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1662b4b2-5935-4c79-8229-60dc9f039ade -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 Apr 15 22:27:03 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:03 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1662b4b2-5935-4c79-8229-60dc9f039ade -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9" returned: 0 in 0.423s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:03 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 is being set with open permissions: ugo+rw Apr 15 22:27:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:03 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 Apr 15 22:27:03 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:04 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9" returned: 0 in 0.406s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:04 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.info Apr 15 22:27:04 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:04 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.info" returned: 0 in 0.420s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:04 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.info is being set with open permissions: ugo+rw Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:04 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.info Apr 15 22:27:04 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:04 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.info" returned: 0 in 0.406s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.834s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-653624902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80876fae-e625-4fce-ae1f-a9d2da84450e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938751c2b9f54d38bee656e00893cb6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:03Z,use_quota=True,user_id='d330fedcf61c4ac3b7fca2a301f58819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Creating volume 80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:04 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:04 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e 1073741824 Apr 15 22:27:04 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3de9a5f3-b681-49dc-aba2-649833611fea tempest-CreateVolumesFromSnapshotTest-1163674350 None] Create snapshot completed successfully Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (8d21b000-c5f4-4551-a6c4-f156345c1070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a80c5e0-ba10-4ba0-bb56-6ece94a88206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a80c5e0-ba10-4ba0-bb56-6ece94a88206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389093643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0657a1-9f1e-4b6f-9a74-9c1137ad2779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:05Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0682a809-86f2-4801-9526-28c14e48a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0682a809-86f2-4801-9526-28c14e48a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80ab4cc-5ed2-466d-b16f-b3cdfd7e4179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80ab4cc-5ed2-466d-b16f-b3cdfd7e4179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a0657a1-9f1e-4b6f-9a74-9c1137ad2779', 'volume_name': 'volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aca248e-1733-49f1-b0c0-28d70c14d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aca248e-1733-49f1-b0c0-28d70c14d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc15f11-2479-410a-a0a2-2f8c170d9047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume 3a0657a1-9f1e-4b6f-9a74-9c1137ad2779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779', 'volume_size': 1} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e 1073741824" returned: 0 in 0.591s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:05 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e Apr 15 22:27:05 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (747ca2d9-e407-4097-9ae4-36844ebacca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3acdcf-272c-4f5f-8aee-341cd2435b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3acdcf-272c-4f5f-8aee-341cd2435b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1932627326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db37db12-9a2f-4a92-b9b5-78d3d929f8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a01c4c-cae8-452f-a502-7a02658d7c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a01c4c-cae8-452f-a502-7a02658d7c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83995184-92be-48c7-acc6-b70863c3ba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83995184-92be-48c7-acc6-b70863c3ba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db37db12-9a2f-4a92-b9b5-78d3d929f8ad', 'volume_name': 'volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500df971-b29f-45a9-81b2-96963e3b8000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500df971-b29f-45a9-81b2-96963e3b8000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8035ef5f-0242-494a-a31b-0223bd2b61cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume db37db12-9a2f-4a92-b9b5-78d3d929f8ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad', 'volume_size': 1} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (9da010c3-0452-4663-a232-def55a9fd7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8882e737-23b7-44e2-b9db-1a8ec13da9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8882e737-23b7-44e2-b9db-1a8ec13da9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-242936936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bccaf7-8312-4419-895e-aecb9db7d78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6398b3dc-2139-42c1-8c78-d218d99c8974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6398b3dc-2139-42c1-8c78-d218d99c8974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee51a6-22a0-4303-95a8-c770f609cde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee51a6-22a0-4303-95a8-c770f609cde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bccaf7-8312-4419-895e-aecb9db7d78a', 'volume_name': 'volume-d3bccaf7-8312-4419-895e-aecb9db7d78a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe96a56c-d216-452f-b0ec-39a60377d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe96a56c-d216-452f-b0ec-39a60377d90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff390aee-9881-4bac-aed7-05c4b5de4f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:05 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume d3bccaf7-8312-4419-895e-aecb9db7d78a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bccaf7-8312-4419-895e-aecb9db7d78a', 'volume_size': 1} Apr 15 22:27:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:06 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (a7f00b1a-fc94-42a4-9e9d-c9b72e472593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f0c601-c7e5-4efd-9a8a-e9eaf4d9bb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e" returned: 0 in 0.510s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389093643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a0657a1-9f1e-4b6f-9a74-9c1137ad2779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:05Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Creating volume 3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:06 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24f0c601-c7e5-4efd-9a8a-e9eaf4d9bb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1971575350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aad863-7f63-4a23-b699-205b433766af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 1073741824 Apr 15 22:27:06 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff8c15e-9629-405d-b5fd-e14f3c95d279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff8c15e-9629-405d-b5fd-e14f3c95d279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d812bba-5cb3-4517-aa09-448de0a1187c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d812bba-5cb3-4517-aa09-448de0a1187c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0aad863-7f63-4a23-b699-205b433766af', 'volume_name': 'volume-d0aad863-7f63-4a23-b699-205b433766af', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1418778-0434-4d16-839c-d71fcb42c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1418778-0434-4d16-839c-d71fcb42c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f7e825-48db-4f38-a799-ebf7b174eb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume d0aad863-7f63-4a23-b699-205b433766af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0aad863-7f63-4a23-b699-205b433766af', 'volume_size': 1} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7c34df-8d09-47c9-b847-91f39d89e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80876fae-e625-4fce-ae1f-a9d2da84450e', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb24051-ffab-4557-8c9c-ad455c6afec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Volume volume-80876fae-e625-4fce-ae1f-a9d2da84450e (80876fae-e625-4fce-ae1f-a9d2da84450e): created successfully Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb24051-ffab-4557-8c9c-ad455c6afec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Flow 'volume_create_manager' (049f74a6-759d-4ac1-a261-232fe612d922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:06 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fc239cc6-e866-4f70-8a10-be4c998eea26 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Created volume successfully. Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (739d4b79-682d-4b54-9a69-a64e28844bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8affc027-6f00-4437-af0c-07eb815d9f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8affc027-6f00-4437-af0c-07eb815d9f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126625394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decca950-f9a0-4e53-8ec7-053d008124ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec8b8fc-c501-4aca-8ffb-3370c4ce3f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec8b8fc-c501-4aca-8ffb-3370c4ce3f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955cfb41-ab77-4793-ae2f-27e6c647fb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955cfb41-ab77-4793-ae2f-27e6c647fb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decca950-f9a0-4e53-8ec7-053d008124ef', 'volume_name': 'volume-decca950-f9a0-4e53-8ec7-053d008124ef', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71aaf09-4332-46bd-b7b9-b2d3f5f3ca75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71aaf09-4332-46bd-b7b9-b2d3f5f3ca75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd01d55-7ce4-4ebc-b1ed-ab2a27a23756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:06 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume decca950-f9a0-4e53-8ec7-053d008124ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decca950-f9a0-4e53-8ec7-053d008124ef', 'volume_size': 1} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:06 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 1073741824" returned: 0 in 0.547s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:06 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 Apr 15 22:27:06 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:07 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779" returned: 0 in 0.407s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.322s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1932627326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db37db12-9a2f-4a92-b9b5-78d3d929f8ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Creating volume db37db12-9a2f-4a92-b9b5-78d3d929f8ad {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:07 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc15f11-2479-410a-a0a2-2f8c170d9047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5fd40a-a3ec-4bca-9f1d-d20118dfa447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:07 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad 1073741824 Apr 15 22:27:07 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:07 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 (3a0657a1-9f1e-4b6f-9a74-9c1137ad2779): created successfully Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5fd40a-a3ec-4bca-9f1d-d20118dfa447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (8d21b000-c5f4-4551-a6c4-f156345c1070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:07 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6d09ee65-c120-4505-9f9f-590e12d84d41 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created volume successfully. Apr 15 22:27:07 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad 1073741824" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:07 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad Apr 15 22:27:07 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:08 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad" returned: 0 in 0.412s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-242936936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bccaf7-8312-4419-895e-aecb9db7d78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Creating volume d3bccaf7-8312-4419-895e-aecb9db7d78a {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:08 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8035ef5f-0242-494a-a31b-0223bd2b61cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60225ff3-c9b2-4e03-b033-afb19a440dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:08 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a 1073741824 Apr 15 22:27:08 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:08 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad (db37db12-9a2f-4a92-b9b5-78d3d929f8ad): created successfully Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60225ff3-c9b2-4e03-b033-afb19a440dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (747ca2d9-e407-4097-9ae4-36844ebacca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:08 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5ff4a454-b48a-4dd8-9b6c-690c4d4407c4 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created volume successfully. Apr 15 22:27:08 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a 1073741824" returned: 0 in 0.547s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:08 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a Apr 15 22:27:08 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:09 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a" returned: 0 in 0.412s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.881s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1971575350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0aad863-7f63-4a23-b699-205b433766af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Creating volume d0aad863-7f63-4a23-b699-205b433766af {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:09 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff390aee-9881-4bac-aed7-05c4b5de4f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bccaf7-8312-4419-895e-aecb9db7d78a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc1bb70-d006-4ae9-aff5-0ac56c7db469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:09 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af 1073741824 Apr 15 22:27:09 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:09 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume volume-d3bccaf7-8312-4419-895e-aecb9db7d78a (d3bccaf7-8312-4419-895e-aecb9db7d78a): created successfully Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc1bb70-d006-4ae9-aff5-0ac56c7db469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (9da010c3-0452-4663-a232-def55a9fd7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a57c4701-f57a-428a-a98d-e3dc1efc6cc5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created volume successfully. Apr 15 22:27:09 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af 1073741824" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:09 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af Apr 15 22:27:09 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:09 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af" returned: 0 in 0.413s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.687s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126625394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decca950-f9a0-4e53-8ec7-053d008124ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a711222173b841c8826d14643f06d130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:06Z,use_quota=True,user_id='5fbcfb728a9f4cdba361406ed8722664',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Creating volume decca950-f9a0-4e53-8ec7-053d008124ef {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:09 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f7e825-48db-4f38-a799-ebf7b174eb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0aad863-7f63-4a23-b699-205b433766af', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:09 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9172d9-9cfb-4c3f-8faf-c8ca428d2c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:09 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef 1073741824 Apr 15 22:27:09 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume volume-d0aad863-7f63-4a23-b699-205b433766af (d0aad863-7f63-4a23-b699-205b433766af): created successfully Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e9172d9-9cfb-4c3f-8faf-c8ca428d2c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (a7f00b1a-fc94-42a4-9e9d-c9b72e472593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:10 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-24a0101b-27e7-464b-af02-77f4cd5c5930 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created volume successfully. Apr 15 22:27:10 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef 1073741824" returned: 0 in 0.476s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:10 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef Apr 15 22:27:10 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:10 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef" returned: 0 in 0.432s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.493s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Creating offline snapshot ecd2add8-b9f8-4779-a5b7-97d74195a9f8 of volume 80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd01d55-7ce4-4ebc-b1ed-ab2a27a23756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decca950-f9a0-4e53-8ec7-053d008124ef', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c04312-d114-46d0-b7ba-40d7a26575df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49ebe51-8f70-444b-8f83-b63dc9627853]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Volume volume-decca950-f9a0-4e53-8ec7-053d008124ef (decca950-f9a0-4e53-8ec7-053d008124ef): created successfully Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c04312-d114-46d0-b7ba-40d7a26575df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Flow 'volume_create_manager' (739d4b79-682d-4b54-9a69-a64e28844bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:10 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-700ef04a-8636-446d-86ad-fdc0835bfea5 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created volume successfully. Apr 15 22:27:11 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e Apr 15 22:27:11 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:11 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:11 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 1G Apr 15 22:27:11 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-decca950-f9a0-4e53-8ec7-053d008124ef-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-decca950-f9a0-4e53-8ec7-053d008124ef-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-decca950-f9a0-4e53-8ec7-053d008124ef" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-decca950-f9a0-4e53-8ec7-053d008124ef" acquired by "delete_volume" :: waited 0.019s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4606ce-aa6b-4cc7-a628-ba92155ac3dc]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:11 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef Apr 15 22:27:11 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:11 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 1G" returned: 0 in 0.491s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80876fae-e625-4fce-ae1f-a9d2da84450e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:11 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80876fae-e625-4fce-ae1f-a9d2da84450e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 Apr 15 22:27:11 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:12 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef" returned: 0 in 0.486s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:12 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef Apr 15 22:27:12 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:12 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80876fae-e625-4fce-ae1f-a9d2da84450e -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8" returned: 0 in 0.432s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:12 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 is being set with open permissions: ugo+rw Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:12 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 Apr 15 22:27:12 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:12 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-decca950-f9a0-4e53-8ec7-053d008124ef" returned: 0 in 0.426s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-decca950-f9a0-4e53-8ec7-053d008124ef" released by "delete_volume" :: held 0.935s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created reservations ['3e709e70-1273-442a-8b18-fb4030ddef5f', '7e6b7fe1-7873-4e31-b1ec-635880eda6d7', '5db9e280-e4ad-4ad9-8f4b-fcdf8ad4abd1', 'e7e64e41-6cc4-4ddf-80d6-1df48e8e7bb2'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:12 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:12 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:12 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8" returned: 0 in 0.430s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-d0aad863-7f63-4a23-b699-205b433766af-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-d0aad863-7f63-4a23-b699-205b433766af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:12 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.info Apr 15 22:27:12 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-d0aad863-7f63-4a23-b699-205b433766af" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-d0aad863-7f63-4a23-b699-205b433766af" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bc5bb3-6ea1-4623-a1b0-2b70ac0c7326]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:12 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af Apr 15 22:27:12 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:13 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.409s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:13 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Deleted volume successfully. Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b6d89f3a-31e2-4765-bc09-0a6ee8c24340 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-decca950-f9a0-4e53-8ec7-053d008124ef-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:13 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.info" returned: 0 in 0.464s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:13 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.info is being set with open permissions: ugo+rw Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:13 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.info Apr 15 22:27:13 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:13 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af" returned: 0 in 0.574s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:13 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af Apr 15 22:27:13 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:13 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.info" returned: 0 in 0.440s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.817s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:13 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9d54dd6e-a2bf-4ee6-8d2e-8729f1a4671b tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Create snapshot completed successfully Apr 15 22:27:13 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d0aad863-7f63-4a23-b699-205b433766af" returned: 0 in 0.420s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-d0aad863-7f63-4a23-b699-205b433766af" released by "delete_volume" :: held 1.021s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created reservations ['103bf127-8566-4838-b6d3-95e231f38583', '2b05d6e3-5346-45cb-b3a6-02e79f696926', '5d043146-b9e5-4f8f-9dda-18a9dc7581f3', '000e064d-9560-4906-84ed-964de363f549'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:13 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:13 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:14 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.403s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Deleted volume successfully. Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b343e8df-7cd7-495b-aff9-f27df009f8d9 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-d0aad863-7f63-4a23-b699-205b433766af-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "cinder-ecd2add8-b9f8-4779-a5b7-97d74195a9f8-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-ecd2add8-b9f8-4779-a5b7-97d74195a9f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "cinder-quobyte-80876fae-e625-4fce-ae1f-a9d2da84450e" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-d3bccaf7-8312-4419-895e-aecb9db7d78a-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-quobyte-80876fae-e625-4fce-ae1f-a9d2da84450e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "cinder-quobyte-ecd2add8-b9f8-4779-a5b7-97d74195a9f8" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-d3bccaf7-8312-4419-895e-aecb9db7d78a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-quobyte-ecd2add8-b9f8-4779-a5b7-97d74195a9f8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:14 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Deleting offline snapshot ecd2add8-b9f8-4779-a5b7-97d74195a9f8 of volume 80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] snapshot_file for this snap is: volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[97197298-8b72-4581-8036-613c5de75f70]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-d3bccaf7-8312-4419-895e-aecb9db7d78a" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-d3bccaf7-8312-4419-895e-aecb9db7d78a" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[223e97d7-2e5c-4379-8880-3949bf25db03]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:15 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 Apr 15 22:27:15 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:15 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a Apr 15 22:27:15 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:15 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8" returned: 0 in 0.479s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80876fae-e625-4fce-ae1f-a9d2da84450e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b49363-7a87-4502-a15e-8f08ebeed348]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:15 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a" returned: 0 in 0.480s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:15 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a Apr 15 22:27:15 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:15 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e Apr 15 22:27:15 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:15 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-d3bccaf7-8312-4419-895e-aecb9db7d78a" returned: 0 in 0.420s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-d3bccaf7-8312-4419-895e-aecb9db7d78a" released by "delete_volume" :: held 0.924s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:15 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:16 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 Apr 15 22:27:16 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created reservations ['37a8ecac-6a7a-4dda-a0e2-417274cd5b21', '2a9aebb3-d087-4a19-bebb-edaa612ceff9', 'bee66f64-ac1a-4e0a-a6c4-b07b96321155', 'aa4303a0-5d2f-4be9-8cf2-53429ad9a5cf'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:16 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:16 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:16 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8" returned: 0 in 0.475s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:16 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8 Apr 15 22:27:16 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:16 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.447s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Deleted volume successfully. Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-5391414b-1c1b-440d-8d5d-0a7ceea3c1f7 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-d3bccaf7-8312-4419-895e-aecb9db7d78a-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:16 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e.ecd2add8-b9f8-4779-a5b7-97d74195a9f8" returned: 0 in 0.417s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-quobyte-ecd2add8-b9f8-4779-a5b7-97d74195a9f8" released by "_delete_snapshot" :: held 1.901s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-quobyte-80876fae-e625-4fce-ae1f-a9d2da84450e" released by "delete_snapshot" :: held 1.926s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Created reservations ['430678c9-832e-48b4-9b63-e6ada5faa384', '7f669166-113f-44e3-8734-2ac10f0999de', '909f9edf-c4e1-4bfc-952a-71ed878ebcdd', 'f9d12562-790e-4a6b-98bd-3f835b125678'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Delete snapshot completed successfully. Apr 15 22:27:16 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-028639c5-44d9-4426-8b92-39b5cb7fa694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-ecd2add8-b9f8-4779-a5b7-97d74195a9f8-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "cinder-80876fae-e625-4fce-ae1f-a9d2da84450e-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-80876fae-e625-4fce-ae1f-a9d2da84450e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "cinder-quobyte-80876fae-e625-4fce-ae1f-a9d2da84450e" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-quobyte-80876fae-e625-4fce-ae1f-a9d2da84450e" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-db37db12-9a2f-4a92-b9b5-78d3d929f8ad-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef642382-8f24-4e0f-882a-a89a3cc3a385]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-db37db12-9a2f-4a92-b9b5-78d3d929f8ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-db37db12-9a2f-4a92-b9b5-78d3d929f8ad" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-db37db12-9a2f-4a92-b9b5-78d3d929f8ad" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b79fdd-d32c-4851-a008-cddeb3fd4d00]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:17 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e Apr 15 22:27:17 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:17 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad Apr 15 22:27:17 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:17 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:17 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:17 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e" returned: 0 in 0.501s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:17 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e Apr 15 22:27:17 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:17 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad" returned: 0 in 0.476s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:17 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad Apr 15 22:27:17 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:17 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.430s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:17 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:18 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-80876fae-e625-4fce-ae1f-a9d2da84450e" returned: 0 in 0.430s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-quobyte-80876fae-e625-4fce-ae1f-a9d2da84450e" released by "delete_volume" :: held 0.966s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:18 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db37db12-9a2f-4a92-b9b5-78d3d929f8ad" returned: 0 in 0.414s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-db37db12-9a2f-4a92-b9b5-78d3d929f8ad" released by "delete_volume" :: held 0.909s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Created reservations ['93d4dd7b-8bdb-4e85-aa28-cfd2cb483402', '91d9413a-5ebc-4bce-be0d-9572fd04477d', 'd98157cd-959d-4184-8a7a-7459eedbcd13', '6a2f4c13-25ee-474f-9535-caaa3467cbe6'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created reservations ['e08d501a-74e1-425a-b8d9-dea0001c1292', '3787abcd-5993-4ee8-b229-c1535f9c3452', '1dbbe942-5c8d-4892-9f3e-0e24ea196db4', 'b34b5676-0a97-44cb-bd83-03330a894d3e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:18 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:18 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:18 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:18 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[946b14d6-dc1e-4f80-b776-42aec662bfc7]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:18 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 Apr 15 22:27:18 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:18 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.429s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Deleted volume successfully. Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b447c608-050b-49c4-b1d0-b5f967aaaa35 tempest-VolumeSnapshotQuotasNegativeTestJSON-1325169084 None] Lock "cinder-80876fae-e625-4fce-ae1f-a9d2da84450e-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:18 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.467s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Deleted volume successfully. Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6a142bea-4763-4cce-807c-e1c7e01c5fca tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-db37db12-9a2f-4a92-b9b5-78d3d929f8ad-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:18 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779" returned: 0 in 0.507s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:18 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779 Apr 15 22:27:18 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:19 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779" returned: 0 in 0.399s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779" released by "delete_volume" :: held 0.936s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created reservations ['1432a56b-b8b5-4902-ad4b-41007a5c0413', '459bb6dc-81f3-41ff-b6a6-0cbd8c686d69', '63826cc2-ecb2-420e-bea8-bc9030af192d', 'ca052064-2cdf-46ec-980c-4c1adedd606f'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:19 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:19 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-9b4b00fc-d5b2-49f2-b250-4d64677a54f9-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-9b4b00fc-d5b2-49f2-b250-4d64677a54f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-1662b4b2-5935-4c79-8229-60dc9f039ade" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-1662b4b2-5935-4c79-8229-60dc9f039ade" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-9b4b00fc-d5b2-49f2-b250-4d64677a54f9" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-9b4b00fc-d5b2-49f2-b250-4d64677a54f9" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Deleting offline snapshot 9b4b00fc-d5b2-49f2-b250-4d64677a54f9 of volume 1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] snapshot_file for this snap is: volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7a89e5-edc4-4d7b-a35d-476fc9bb37a2]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:19 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 Apr 15 22:27:19 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:19 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.508s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:19 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Deleted volume successfully. Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-99acc01a-e791-4797-b0be-e8e586bd6a81 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-3a0657a1-9f1e-4b6f-9a74-9c1137ad2779-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:19 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9" returned: 0 in 0.550s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1662b4b2-5935-4c79-8229-60dc9f039ade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1450f1c-c3f0-47fc-94c5-d346eb980190]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:20 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade Apr 15 22:27:20 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:20 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade" returned: 0 in 0.555s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:20 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 Apr 15 22:27:20 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:21 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:21 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9 Apr 15 22:27:21 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:21 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade.9b4b00fc-d5b2-49f2-b250-4d64677a54f9" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-9b4b00fc-d5b2-49f2-b250-4d64677a54f9" released by "_delete_snapshot" :: held 2.108s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-1662b4b2-5935-4c79-8229-60dc9f039ade" released by "delete_snapshot" :: held 2.120s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:21 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created reservations ['3e929e63-34cf-4dc7-8ae7-9c7f4856363c', 'c031139b-9298-49a4-9c7f-988940d8c79a', '195d7187-cf04-4b7f-a565-f53e3816cb44', '94361fbb-43af-465c-a326-ff0eefd975ea'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:21 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Delete snapshot completed successfully. Apr 15 22:27:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-68ba9ee2-fb59-4dff-be4f-61bc9fc0d3aa tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-9b4b00fc-d5b2-49f2-b250-4d64677a54f9-delete_snapshot" released by "delete_snapshot" :: held 2.208s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-1662b4b2-5935-4c79-8229-60dc9f039ade-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-1662b4b2-5935-4c79-8229-60dc9f039ade-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "cinder-quobyte-1662b4b2-5935-4c79-8229-60dc9f039ade" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-1662b4b2-5935-4c79-8229-60dc9f039ade" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:22 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc34ce5-1249-4403-b063-3393ae60db7c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:22 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade Apr 15 22:27:22 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:23 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade" returned: 0 in 0.524s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:23 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade Apr 15 22:27:23 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Flow 'volume_create_manager' (c4f5470f-bf8c-4e97-8381-9a8d9a067d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48578f43-b038-4aa9-b7c9-27245b9cbf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48578f43-b038-4aa9-b7c9-27245b9cbf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-760837969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03bffee8e77e4d448d755ad5c532403f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:23Z,use_quota=True,user_id='c737173188324d7784ad7ef90e4cda3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41ebaac-101a-4dd5-bbb7-179e0543f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41ebaac-101a-4dd5-bbb7-179e0543f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca43abc-47f2-49e5-8468-8f9cfeff6648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ca43abc-47f2-49e5-8468-8f9cfeff6648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea', 'volume_name': 'volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51199213-abd7-4b4e-8b67-949b28654e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51199213-abd7-4b4e-8b67-949b28654e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef3b216-f483-41a5-9ac8-f8160aad71ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:23 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Volume 2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea', 'volume_size': 1} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-760837969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03bffee8e77e4d448d755ad5c532403f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:23Z,use_quota=True,user_id='c737173188324d7784ad7ef90e4cda3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Creating volume 2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:23 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:23 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea 1073741824 Apr 15 22:27:23 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:23 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1662b4b2-5935-4c79-8229-60dc9f039ade" returned: 0 in 0.444s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-quobyte-1662b4b2-5935-4c79-8229-60dc9f039ade" released by "delete_volume" :: held 1.001s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Created reservations ['4c1208fa-69a5-4026-bc2e-838ecfa297fc', '459d5793-773b-4341-8b61-d951c96773ae', '594f19b7-6118-4a62-b015-572ba2097776', '08fef6ae-1ea8-486e-b372-75d207012313'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:23 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:23 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:23 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea 1073741824" returned: 0 in 0.529s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:23 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea Apr 15 22:27:23 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:24 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.421s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:24 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Deleted volume successfully. Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d67f8eaf-945b-4cb2-8321-9ec8c4e909c3 tempest-CreateVolumesFromSnapshotTest-1163674350 None] Lock "cinder-1662b4b2-5935-4c79-8229-60dc9f039ade-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:24 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" returned: 0 in 0.426s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef3b216-f483-41a5-9ac8-f8160aad71ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4642d373-6892-456b-a6a8-7a625e5c0c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:24 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Volume volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea (2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea): created successfully Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4642d373-6892-456b-a6a8-7a625e5c0c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:24 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Flow 'volume_create_manager' (c4f5470f-bf8c-4e97-8381-9a8d9a067d9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:24 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d8144574-7e22-49e0-a641-ee262a31d669 tempest-SnapshotMetadataTestJSON-299283240 None] Created volume successfully. Apr 15 22:27:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Creating offline snapshot d62e8411-327e-409c-821f-87706ac7961e of volume 2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:27:25 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d991938-93d3-481e-a7c9-7115159c3da4]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:25 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea Apr 15 22:27:25 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:26 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" returned: 0 in 0.528s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:26 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e 1G Apr 15 22:27:26 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Flow 'volume_create_manager' (5a43c5cb-9032-4534-81bc-16c06ba9cb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cac4e87-6d32-4bd6-a390-eef2961722ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cac4e87-6d32-4bd6-a390-eef2961722ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba5ef02fb84894b5c1a2e4fe636e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:26Z,use_quota=True,user_id='08c366056c36453aa4e948460dbdce35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa485c23-b989-4b12-abbb-c43251b50f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa485c23-b989-4b12-abbb-c43251b50f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f1dd8d-b956-4981-b1db-546f555b2079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f1dd8d-b956-4981-b1db-546f555b2079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5', 'volume_name': 'volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed847e54-eb43-498e-9d23-59f6375fc1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed847e54-eb43-498e-9d23-59f6375fc1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7380ffb-5e20-485f-a3e0-b9e0a7523a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:26 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Volume b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5', 'volume_size': 1} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:26 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e 1G" returned: 0 in 0.536s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:26 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e Apr 15 22:27:26 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:27 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e" returned: 0 in 0.427s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:27 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e is being set with open permissions: ugo+rw Apr 15 22:27:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:27 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e Apr 15 22:27:27 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:27 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e" returned: 0 in 0.423s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:27 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.info Apr 15 22:27:27 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:27 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.info" returned: 0 in 0.430s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:27 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.info is being set with open permissions: ugo+rw Apr 15 22:27:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:27 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.info Apr 15 22:27:27 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:28 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.info" returned: 0 in 0.413s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.981s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba5ef02fb84894b5c1a2e4fe636e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:26Z,use_quota=True,user_id='08c366056c36453aa4e948460dbdce35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Creating volume b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:28 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:28 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 1073741824 Apr 15 22:27:28 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:28 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b2446bae-dc13-46cb-8e9f-af724fce2fe0 tempest-SnapshotMetadataTestJSON-299283240 None] Create snapshot completed successfully Apr 15 22:27:28 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 1073741824" returned: 0 in 0.517s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:28 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 Apr 15 22:27:28 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "cinder-d62e8411-327e-409c-821f-87706ac7961e-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-d62e8411-327e-409c-821f-87706ac7961e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "cinder-quobyte-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-quobyte-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "cinder-quobyte-d62e8411-327e-409c-821f-87706ac7961e" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-quobyte-d62e8411-327e-409c-821f-87706ac7961e" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Deleting offline snapshot d62e8411-327e-409c-821f-87706ac7961e of volume 2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] snapshot_file for this snap is: volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f3d5e-0a0b-497a-b7c7-6c346eea815f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:29 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e Apr 15 22:27:29 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:29 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7380ffb-5e20-485f-a3e0-b9e0a7523a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbb6844-bbd5-4230-9557-bc70dab2b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:29 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Volume volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 (b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5): created successfully Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbb6844-bbd5-4230-9557-bc70dab2b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Flow 'volume_create_manager' (5a43c5cb-9032-4534-81bc-16c06ba9cb66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:29 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ae6588a5-a4b6-481a-921b-adfd8aa5ace8 tempest-CinderUnicodeTest-463804623 None] Created volume successfully. Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:29 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Flow 'volume_create_manager' (853a744a-c6ca-4bbc-8574-7f1485d9cc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50718647-c29b-4dc0-8deb-633a3038dff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e" returned: 0 in 0.551s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[af078812-dfef-4226-854e-5974d872556e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50718647-c29b-4dc0-8deb-633a3038dff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-424523089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfe0a39-a5f7-4cb9-97aa-770f832d0364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba5ef02fb84894b5c1a2e4fe636e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:30Z,use_quota=True,user_id='08c366056c36453aa4e948460dbdce35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b1f174-3acc-4b9b-ac3f-5d1a806de140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b1f174-3acc-4b9b-ac3f-5d1a806de140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c3271a-2789-4653-8c5e-e30902f0bfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c3271a-2789-4653-8c5e-e30902f0bfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dfe0a39-a5f7-4cb9-97aa-770f832d0364', 'volume_name': 'volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f376ee56-dd20-46e7-846a-4d8df2a42351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f376ee56-dd20-46e7-846a-4d8df2a42351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce39931-10fa-4f77-9db8-473d439f6f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:29 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Volume 6dfe0a39-a5f7-4cb9-97aa-770f832d0364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364', 'volume_size': 1} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-424523089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dfe0a39-a5f7-4cb9-97aa-770f832d0364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ba5ef02fb84894b5c1a2e4fe636e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:30Z,use_quota=True,user_id='08c366056c36453aa4e948460dbdce35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Creating volume 6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:29 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:29 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 1073741824 Apr 15 22:27:29 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:29 devstack sudo[89469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea Apr 15 22:27:29 devstack sudo[89469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:30 devstack sudo[89469]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" returned: 0 in 0.494s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:30 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e Apr 15 22:27:30 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:30 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 1073741824" returned: 0 in 0.496s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:30 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 Apr 15 22:27:30 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:30 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e" returned: 0 in 0.473s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:30 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:30 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e Apr 15 22:27:30 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" returned: 0 in 0.429s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce39931-10fa-4f77-9db8-473d439f6f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264aeff6-af16-4ff0-b141-d2324ff579be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:30 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Volume volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 (6dfe0a39-a5f7-4cb9-97aa-770f832d0364): created successfully Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (264aeff6-af16-4ff0-b141-d2324ff579be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:30 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Flow 'volume_create_manager' (853a744a-c6ca-4bbc-8574-7f1485d9cc2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:30 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8e52cd77-419a-43b6-b1c0-2caa84faccc0 tempest-CinderUnicodeTest-463804623 None] Created volume successfully. Apr 15 22:27:31 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea.d62e8411-327e-409c-821f-87706ac7961e" returned: 0 in 0.407s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-quobyte-d62e8411-327e-409c-821f-87706ac7961e" released by "_delete_snapshot" :: held 1.984s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-quobyte-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" released by "delete_snapshot" :: held 1.997s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Created reservations ['0d5cbb75-c43c-4d85-803f-41b73b7db7c2', '7c6e6171-4497-4e2b-996f-f62af949d874', '7c186385-28ad-4a09-b8f1-a69d964041d6', '4cafb368-a474-43bc-959d-77f08d69af6e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:31 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Delete snapshot completed successfully. Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-fab432b8-962e-4310-abdf-583c0f41bdbf tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-d62e8411-327e-409c-821f-87706ac7961e-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Creating offline snapshot 2f82c41a-b413-41f6-9457-f3af6969637b of volume 6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16cf405-6aa6-47c7-88dd-14ecd06acb98]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:32 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 Apr 15 22:27:32 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:32 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" returned: 0 in 0.470s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:32 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b 1G Apr 15 22:27:32 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "cinder-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "cinder-quobyte-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-quobyte-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61f1b90-ae3e-4177-b8b0-2facf778abf0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:32 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea Apr 15 22:27:32 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:32 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b 1G" returned: 0 in 0.517s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:32 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b Apr 15 22:27:32 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:33 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:33 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea Apr 15 22:27:33 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:33 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b" returned: 0 in 0.435s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:33 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b is being set with open permissions: ugo+rw Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:33 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b Apr 15 22:27:33 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:33 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" returned: 0 in 0.428s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-quobyte-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea" released by "delete_volume" :: held 0.957s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Created reservations ['199e3a22-253e-4c75-9aa0-9c2fa5dc2712', '7892ef93-1b88-41f1-8d55-7ba8ac3d5ea8', '0aa2ff04-fb2f-4a2a-87bb-60f0d81a6571', '4a5713c9-4779-4173-94b5-9b7ce5f573fb'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:33 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:33 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:33 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b" returned: 0 in 0.494s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:33 devstack sudo[89519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.info Apr 15 22:27:33 devstack sudo[89519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:34 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.481s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:34 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:34 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Deleted volume successfully. Apr 15 22:27:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1d9f897d-80f2-41f1-94cb-1c06565d3898 tempest-SnapshotMetadataTestJSON-299283240 None] Lock "cinder-2f65dcca-c1ce-4da5-bdd9-8a8c034a44ea-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:34 devstack sudo[89519]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.info" returned: 0 in 0.521s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:34 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.info is being set with open permissions: ugo+rw Apr 15 22:27:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:34 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.info Apr 15 22:27:34 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:34 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.info" returned: 0 in 0.425s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.918s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:34 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-37767720-aee2-4693-803e-1645fb2b72b0 tempest-CinderUnicodeTest-463804623 None] Create snapshot completed successfully Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Acquiring lock "cinder-2f82c41a-b413-41f6-9457-f3af6969637b-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Lock "cinder-2f82c41a-b413-41f6-9457-f3af6969637b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Acquiring lock "cinder-quobyte-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Acquiring lock "cinder-quobyte-2f82c41a-b413-41f6-9457-f3af6969637b" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-2f82c41a-b413-41f6-9457-f3af6969637b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Deleting offline snapshot 2f82c41a-b413-41f6-9457-f3af6969637b of volume 6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] snapshot_file for this snap is: volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa26fbeb-9b40-4b54-bbd9-3a125e15e2d0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:35 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b Apr 15 22:27:35 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:35 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b" returned: 0 in 0.518s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[87999819-ee17-4534-9368-33363b88e707]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:35 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 Apr 15 22:27:35 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Flow 'volume_create_manager' (3e93a47b-6450-4e69-be8b-9375fefe8dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07005120-6fef-4601-b675-75a7d70fb80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07005120-6fef-4601-b675-75a7d70fb80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1398461557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa893594-8003-4e0b-aff2-b9b775f54941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a43f684ed2349efa2bf29532642dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:36Z,use_quota=True,user_id='b5a7278ed3284c108f5da7d0810619bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54e4a4b-78f8-4f05-b94f-e484ecc7e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54e4a4b-78f8-4f05-b94f-e484ecc7e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12a9e81-67eb-4f0d-9dd2-bd59da3710a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12a9e81-67eb-4f0d-9dd2-bd59da3710a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa893594-8003-4e0b-aff2-b9b775f54941', 'volume_name': 'volume-aa893594-8003-4e0b-aff2-b9b775f54941', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71391d63-1877-4916-932e-471b2ceae4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71391d63-1877-4916-932e-471b2ceae4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7d7c94-332a-497b-8ec0-8f3f230b5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:36 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Volume aa893594-8003-4e0b-aff2-b9b775f54941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa893594-8003-4e0b-aff2-b9b775f54941', 'volume_size': 1} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1398461557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa893594-8003-4e0b-aff2-b9b775f54941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a43f684ed2349efa2bf29532642dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:36Z,use_quota=True,user_id='b5a7278ed3284c108f5da7d0810619bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Creating volume aa893594-8003-4e0b-aff2-b9b775f54941 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:36 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:36 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 1073741824 Apr 15 22:27:36 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:36 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" returned: 0 in 0.552s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:36 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b Apr 15 22:27:36 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:36 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 1073741824" returned: 0 in 0.491s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:36 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b" returned: 0 in 0.480s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:36 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 Apr 15 22:27:36 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:36 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b Apr 15 22:27:36 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:37 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941" returned: 0 in 0.412s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=153,cinder:DELETE=16,cinder:INSERT=59,cinder:UPDATE=193 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7d7c94-332a-497b-8ec0-8f3f230b5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa893594-8003-4e0b-aff2-b9b775f54941', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:37 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0325c4e8-47f3-4f05-88df-e6f2ae60aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=212,cinder:DELETE=19,cinder:SELECT=158,cinder:INSERT=43 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364.2f82c41a-b413-41f6-9457-f3af6969637b" returned: 0 in 0.424s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:37 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Volume volume-aa893594-8003-4e0b-aff2-b9b775f54941 (aa893594-8003-4e0b-aff2-b9b775f54941): created successfully Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0325c4e8-47f3-4f05-88df-e6f2ae60aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Flow 'volume_create_manager' (3e93a47b-6450-4e69-be8b-9375fefe8dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-08b81bde-c1d3-42c1-bcde-d1c60f90a2a9 tempest-VolumesTransfersTest-705251912 None] Created volume successfully. Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-2f82c41a-b413-41f6-9457-f3af6969637b" released by "_delete_snapshot" :: held 2.058s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" released by "delete_snapshot" :: held 2.078s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Created reservations ['0f1256f4-d003-48e6-9134-c2d9ff71224b', 'c069b7fd-3905-4356-8a69-037cd4a5b396', '370173ab-52b5-43b1-a59e-cc07a340dde8', 'af980ab0-21bc-4814-b556-cf6f17c3c0d7'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Delete snapshot completed successfully. Apr 15 22:27:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8d34c627-62bc-430d-9693-b2b4b7bfc7ff tempest-CinderUnicodeTest-463804623 None] Lock "cinder-2f82c41a-b413-41f6-9457-f3af6969637b-delete_snapshot" released by "delete_snapshot" :: held 2.151s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "cinder-6dfe0a39-a5f7-4cb9-97aa-770f832d0364-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-6dfe0a39-a5f7-4cb9-97aa-770f832d0364-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "cinder-quobyte-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[787412c5-d0ce-4831-991d-af468ecbb828]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:38 devstack sudo[89554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 Apr 15 22:27:38 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-147eca99-d464-4261-8e56-17f3a73f8b78 tempest-VolumesTransfersTest-1448549630 None] Transfer volume completed successfully. Apr 15 22:27:38 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" returned: 0 in 0.508s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:38 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:38 devstack sudo[89559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364 Apr 15 22:27:38 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:39 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" returned: 0 in 0.422s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-6dfe0a39-a5f7-4cb9-97aa-770f832d0364" released by "delete_volume" :: held 0.967s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Created reservations ['7238f29f-d616-426e-b85c-cfb72f0c5060', 'a1456e38-b703-4acf-a1c2-d311b9ca8322', 'e2a13c48-015d-4cc0-abdd-d4bddb1450af', '3f321939-9468-4100-a877-7a990b61f963'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:39 devstack sudo[89562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:39 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Acquiring lock "cinder-aa893594-8003-4e0b-aff2-b9b775f54941-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "cinder-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Lock "cinder-aa893594-8003-4e0b-aff2-b9b775f54941-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Acquiring lock "cinder-quobyte-aa893594-8003-4e0b-aff2-b9b775f54941" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "cinder-quobyte-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Lock "cinder-quobyte-aa893594-8003-4e0b-aff2-b9b775f54941" acquired by "delete_volume" :: waited 0.018s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efcefca-7658-4047-9234-8a0c65d23324]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b206a0c9-787c-42e9-b494-26c34da5483c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:39 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 Apr 15 22:27:39 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:39 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 Apr 15 22:27:39 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:39 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.475s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:39 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Deleted volume successfully. Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-a944d09e-d52f-4cea-a843-d8c73a2fb679 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-6dfe0a39-a5f7-4cb9-97aa-770f832d0364-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:39 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5" returned: 0 in 0.470s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:39 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941" returned: 0 in 0.492s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:39 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5 Apr 15 22:27:39 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:39 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941 Apr 15 22:27:39 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:40 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:40 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5" returned: 0 in 0.416s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-aa893594-8003-4e0b-aff2-b9b775f54941" returned: 0 in 0.411s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-quobyte-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5" released by "delete_volume" :: held 0.918s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Lock "cinder-quobyte-aa893594-8003-4e0b-aff2-b9b775f54941" released by "delete_volume" :: held 0.936s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Created reservations ['48c31665-affa-445c-9bb1-d1adf8557264', '0b30494c-4c53-45c7-ba22-6a012b71b1ec', '97f499db-9d31-496c-85ae-3f00a9c19d3f', 'cdd5b3e6-c350-43fb-ae3d-53aefc9bd9b8'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Created reservations ['48cab1e1-97e0-4d08-9447-81ef2ae2f32e', '4f5a4fc6-ba76-433f-a35d-f6af9eec3e61', 'aacad942-550c-4d83-be55-fb94596cab81', '7f6639e9-df0b-43ea-9803-bcd066f36d91'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:40 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:40 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:40 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:40 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:40 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.409s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Deleted volume successfully. Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c78397de-1ba6-410b-bf87-49342aa4dbc0 tempest-CinderUnicodeTest-463804623 None] Lock "cinder-b5e0e7fe-e4e0-4f55-a2f3-a4bc67d9cbd5-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:40 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.416s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Deleted volume successfully. Apr 15 22:27:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-0970d6ce-2ae8-434f-933f-0d676ac1d394 tempest-VolumesTransfersTest-976857718 None] Lock "cinder-aa893594-8003-4e0b-aff2-b9b775f54941-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Flow 'volume_create_manager' (bda498f0-3b7c-4751-aa50-0c689d1b4dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636218ef-b2a2-484f-8e58-e0fed7ec04d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636218ef-b2a2-484f-8e58-e0fed7ec04d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-379235531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db951404-7d86-4a49-b751-c4261df3bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a43f684ed2349efa2bf29532642dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:42Z,use_quota=True,user_id='b5a7278ed3284c108f5da7d0810619bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f669a79f-d518-41d3-9c60-69d679f0d01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f669a79f-d518-41d3-9c60-69d679f0d01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3849d5-14ec-4a50-a2a2-e1cf0c447263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3849d5-14ec-4a50-a2a2-e1cf0c447263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db951404-7d86-4a49-b751-c4261df3bab6', 'volume_name': 'volume-db951404-7d86-4a49-b751-c4261df3bab6', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b71275-3025-48f7-afd7-11d4a118a8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b71275-3025-48f7-afd7-11d4a118a8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22dc3fd1-ad32-44f2-8727-1022afae6d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Volume db951404-7d86-4a49-b751-c4261df3bab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db951404-7d86-4a49-b751-c4261df3bab6', 'volume_size': 1} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-379235531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db951404-7d86-4a49-b751-c4261df3bab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a43f684ed2349efa2bf29532642dac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:42Z,use_quota=True,user_id='b5a7278ed3284c108f5da7d0810619bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Creating volume db951404-7d86-4a49-b751-c4261df3bab6 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:41 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:41 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 1073741824 Apr 15 22:27:41 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:42 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 1073741824" returned: 0 in 0.566s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:42 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 Apr 15 22:27:42 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:42 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6" returned: 0 in 0.420s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22dc3fd1-ad32-44f2-8727-1022afae6d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db951404-7d86-4a49-b751-c4261df3bab6', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6640be2-ae30-474a-9102-e311a08842f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:42 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Volume volume-db951404-7d86-4a49-b751-c4261df3bab6 (db951404-7d86-4a49-b751-c4261df3bab6): created successfully Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6640be2-ae30-474a-9102-e311a08842f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Flow 'volume_create_manager' (bda498f0-3b7c-4751-aa50-0c689d1b4dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-741281b3-67bd-42c8-b6e0-ba9b42b247db tempest-VolumesTransfersTest-705251912 None] Created volume successfully. Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Acquiring lock "cinder-db951404-7d86-4a49-b751-c4261df3bab6-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Lock "cinder-db951404-7d86-4a49-b751-c4261df3bab6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Acquiring lock "cinder-quobyte-db951404-7d86-4a49-b751-c4261df3bab6" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Lock "cinder-quobyte-db951404-7d86-4a49-b751-c4261df3bab6" acquired by "delete_volume" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabdc804-ef35-48c6-8231-bd662e30d927]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:44 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 Apr 15 22:27:44 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:44 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6" returned: 0 in 0.463s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:44 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6 Apr 15 22:27:44 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:45 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-db951404-7d86-4a49-b751-c4261df3bab6" returned: 0 in 0.412s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Lock "cinder-quobyte-db951404-7d86-4a49-b751-c4261df3bab6" released by "delete_volume" :: held 0.902s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Created reservations ['b33193a8-310f-4112-93b4-99a9e795255a', '4ea901e6-4e6b-4020-b16d-72d6f4d9a673', '603686ca-a6fd-4ad3-bece-2ba3bc3530b4', 'e3b10715-2843-4d0f-acb4-5f016fd67760'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:45 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:27:45 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:45 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.438s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:27:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Deleted volume successfully. Apr 15 22:27:45 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-17a71d67-5d32-4fe6-b547-a21cf0217f4a tempest-VolumesTransfersTest-976857718 None] Lock "cinder-db951404-7d86-4a49-b751-c4261df3bab6-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Flow 'volume_create_manager' (97a38f36-ef55-443e-981b-67f28c763bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548ae271-5c90-4023-a6a6-87095c67690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548ae271-5c90-4023-a6a6-87095c67690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-133831754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e556aa-2daf-4a1e-be19-8fa5f51f2359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b76af905a34ab9b313faa9dabe9eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:48Z,use_quota=True,user_id='4fc54734cc2e42e1bfb296f825c86c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff9bad3-f24d-4405-8188-b49b0e35aafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff9bad3-f24d-4405-8188-b49b0e35aafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d18c437-d465-4874-89b0-50a230492d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d18c437-d465-4874-89b0-50a230492d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e556aa-2daf-4a1e-be19-8fa5f51f2359', 'volume_name': 'volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5158597-7510-4af2-b89f-bc30ebad5534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5158597-7510-4af2-b89f-bc30ebad5534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084a5d95-7031-4961-bfd2-fedbc55e6d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:48 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Volume e7e556aa-2daf-4a1e-be19-8fa5f51f2359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359', 'volume_size': 1} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-133831754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e556aa-2daf-4a1e-be19-8fa5f51f2359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80b76af905a34ab9b313faa9dabe9eb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:27:48Z,use_quota=True,user_id='4fc54734cc2e42e1bfb296f825c86c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Creating volume e7e556aa-2daf-4a1e-be19-8fa5f51f2359 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:27:48 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:48 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 1073741824 Apr 15 22:27:48 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:48 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 1073741824" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:27:48 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 Apr 15 22:27:48 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:27:49 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 15 22:27:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359" returned: 0 in 0.406s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:27:49 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:27:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:27:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (084a5d95-7031-4961-bfd2-fedbc55e6d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a1f1f6-dd19-4b1a-9eff-1410c41aab19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:27:49 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Volume volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 (e7e556aa-2daf-4a1e-be19-8fa5f51f2359): created successfully Apr 15 22:27:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8a1f1f6-dd19-4b1a-9eff-1410c41aab19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:27:49 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Flow 'volume_create_manager' (97a38f36-ef55-443e-981b-67f28c763bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:27:49 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-919c7bed-cf7d-4203-b9df-5fb1742a65fd tempest-VolumesNegativeTest-296294579 None] Created volume successfully. Apr 15 22:27:59 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:27:59 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=36,cinder:UPDATE=51,cinder:DELETE=4,cinder:INSERT=13 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:28:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Acquiring lock "cinder-e7e556aa-2daf-4a1e-be19-8fa5f51f2359-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Lock "cinder-e7e556aa-2daf-4a1e-be19-8fa5f51f2359-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Acquiring lock "cinder-quobyte-e7e556aa-2daf-4a1e-be19-8fa5f51f2359" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:12 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Lock "cinder-quobyte-e7e556aa-2daf-4a1e-be19-8fa5f51f2359" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:12 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7bedf3-5d89-4391-bba7-a59b581944ad]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:13 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 Apr 15 22:28:13 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:13 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:13 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359 Apr 15 22:28:13 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:13 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-e7e556aa-2daf-4a1e-be19-8fa5f51f2359" returned: 0 in 0.400s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Lock "cinder-quobyte-e7e556aa-2daf-4a1e-be19-8fa5f51f2359" released by "delete_volume" :: held 0.904s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Created reservations ['10f3c6a2-415d-4b5f-9dfc-aec06bce84ad', 'a2e13350-9dc1-4da0-8f4a-1b92df464ecd', '06c87bfe-b047-4026-a107-14becbfe87b5', 'aed17c92-5205-4c36-a52e-6c9cf14c4fec'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:13 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:13 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:13 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:14 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:14 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:14 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Deleted volume successfully. Apr 15 22:28:14 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-dbbd0612-291f-48f9-bb3b-3a67a816479f tempest-VolumesNegativeTest-296294579 None] Lock "cinder-e7e556aa-2daf-4a1e-be19-8fa5f51f2359-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Flow 'volume_create_manager' (4a3e8b6a-0410-4872-8073-0dfbb7752b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6b9582-212f-4185-9c2a-8817a3fb0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d6b9582-212f-4185-9c2a-8817a3fb0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1499698718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9aac771b8fd4ae2bb9c395e3eee8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:15Z,use_quota=True,user_id='dc5314ee3e2046089b9968b479779faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682d21ab-565d-47ff-8afe-655c765b5663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682d21ab-565d-47ff-8afe-655c765b5663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fef739-e361-4397-abc2-ca0f4ce0726f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77fef739-e361-4397-abc2-ca0f4ce0726f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5', 'volume_name': 'volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea04272-196c-4b69-9e3b-d4661d3ccbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea04272-196c-4b69-9e3b-d4661d3ccbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce2d7b1-1d55-4e70-9c82-e0e2e88b4a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:15 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5', 'volume_size': 1} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1499698718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9aac771b8fd4ae2bb9c395e3eee8f61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:15Z,use_quota=True,user_id='dc5314ee3e2046089b9968b479779faf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Creating volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:15 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:15 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 1073741824 Apr 15 22:28:15 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:15 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 1073741824" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:16 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 Apr 15 22:28:16 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:16 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" returned: 0 in 0.428s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce2d7b1-1d55-4e70-9c82-e0e2e88b4a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6615fc-361a-4934-b7bd-989d133bb446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:16 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Volume volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 (47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5): created successfully Apr 15 22:28:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6615fc-361a-4934-b7bd-989d133bb446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Flow 'volume_create_manager' (4a3e8b6a-0410-4872-8073-0dfbb7752b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-430ed5fa-a1d5-49fa-9ffe-740b36032e03 tempest-VolumesSnapshotListTestJSON-528149575 None] Created volume successfully. Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:17 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:17 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Creating offline snapshot 32eb4514-42eb-419d-b8dd-f118f0342097 of volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c94d19-e960-4443-bcff-1d53eda19815]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:17 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 Apr 15 22:28:17 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:17 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:17 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:18 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" returned: 0 in 0.492s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:18 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 1G Apr 15 22:28:18 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:18 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 1G" returned: 0 in 0.459s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:18 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 Apr 15 22:28:18 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:19 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097" returned: 0 in 0.420s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:19 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 is being set with open permissions: ugo+rw Apr 15 22:28:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:19 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 Apr 15 22:28:19 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:19 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097" returned: 0 in 0.396s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:19 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.info Apr 15 22:28:19 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:19 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.info" returned: 0 in 0.415s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:19 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.info is being set with open permissions: ugo+rw Apr 15 22:28:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:19 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.info Apr 15 22:28:19 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:20 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.info" returned: 0 in 0.397s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.631s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:20 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-72c6b94c-22d4-41f1-819f-cc5d777b3c6e tempest-VolumesSnapshotListTestJSON-528149575 None] Create snapshot completed successfully Apr 15 22:28:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Creating offline snapshot 00467728-30b8-4e17-a1a5-255d5770ff55 of volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:28:20 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de05b8-a113-4e53-bd5a-255167a829c1]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:20 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 Apr 15 22:28:20 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:21 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097" returned: 0 in 0.453s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:21 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 1G Apr 15 22:28:21 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:21 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 1G" returned: 0 in 0.465s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:21 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 Apr 15 22:28:21 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:22 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55" returned: 0 in 0.423s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:22 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 is being set with open permissions: ugo+rw Apr 15 22:28:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:22 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 Apr 15 22:28:22 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:22 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55" returned: 0 in 0.411s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:22 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e28bd16a-86b2-4e05-81b6-d4c37049edce tempest-VolumesSnapshotListTestJSON-528149575 None] Create snapshot completed successfully Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Creating offline snapshot 117d9972-72a7-4dea-ab8f-f7c1115b18d6 of volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d90d5-b054-49ae-8078-060ba542dba5]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:23 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 Apr 15 22:28:23 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:23 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55" returned: 0 in 0.476s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:23 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 1G Apr 15 22:28:23 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:24 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 1G" returned: 0 in 0.476s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:24 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 Apr 15 22:28:24 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:24 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6" returned: 0 in 0.417s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:24 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 is being set with open permissions: ugo+rw Apr 15 22:28:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:24 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 Apr 15 22:28:24 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:24 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6" returned: 0 in 0.394s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:24 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-29959ee2-50fc-463b-888a-124c5f0faa70 tempest-VolumesSnapshotListTestJSON-528149575 None] Create snapshot completed successfully Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-117d9972-72a7-4dea-ab8f-f7c1115b18d6-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-117d9972-72a7-4dea-ab8f-f7c1115b18d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-quobyte-117d9972-72a7-4dea-ab8f-f7c1115b18d6" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-117d9972-72a7-4dea-ab8f-f7c1115b18d6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Deleting offline snapshot 117d9972-72a7-4dea-ab8f-f7c1115b18d6 of volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] snapshot_file for this snap is: volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6bb3d7-358e-4513-9d3d-d98913e616bd]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:25 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 Apr 15 22:28:25 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:26 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6" returned: 0 in 0.456s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:26 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dc2229-dd48-4a71-93ca-7988b6186b06]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:26 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 Apr 15 22:28:26 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:26 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55" returned: 0 in 0.452s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:26 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:26 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 Apr 15 22:28:26 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:27 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6" returned: 0 in 0.457s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:27 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6 Apr 15 22:28:27 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:27 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.117d9972-72a7-4dea-ab8f-f7c1115b18d6" returned: 0 in 0.413s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-117d9972-72a7-4dea-ab8f-f7c1115b18d6" released by "_delete_snapshot" :: held 1.824s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" released by "delete_snapshot" :: held 1.836s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Created reservations ['3ae9490e-028e-49fe-8a06-75fe58309942', 'eed79570-3fd4-43ff-8ba5-fb1c24eb3479', 'bda18f07-940d-4d1e-9d19-659205419333', 'a4b929fc-0986-498e-b4f4-cc539594acf1'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:27 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Delete snapshot completed successfully. Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-51cba9ee-e1d6-4823-a9d6-4cec3a508e48 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-117d9972-72a7-4dea-ab8f-f7c1115b18d6-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-00467728-30b8-4e17-a1a5-255d5770ff55-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-00467728-30b8-4e17-a1a5-255d5770ff55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-quobyte-00467728-30b8-4e17-a1a5-255d5770ff55" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-00467728-30b8-4e17-a1a5-255d5770ff55" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Deleting offline snapshot 00467728-30b8-4e17-a1a5-255d5770ff55 of volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] snapshot_file for this snap is: volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ca866-7907-46e7-83db-b613265e7042]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:27 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:27 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 Apr 15 22:28:27 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:28 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55" returned: 0 in 0.460s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:28 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b8bd04-8a5b-4053-b57e-bf02722b1dd8]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:28 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 Apr 15 22:28:28 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:28 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097" returned: 0 in 0.468s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:28 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 Apr 15 22:28:28 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:29 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55" returned: 0 in 0.443s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:29 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55 Apr 15 22:28:29 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:29 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.00467728-30b8-4e17-a1a5-255d5770ff55" returned: 0 in 0.396s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-00467728-30b8-4e17-a1a5-255d5770ff55" released by "_delete_snapshot" :: held 1.816s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" released by "delete_snapshot" :: held 1.829s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Created reservations ['4c528550-64dc-41ba-af45-4b3d59e52017', 'e63451bf-04ea-4d1f-bbef-3ade8a5daa0f', 'da1f1f54-4d0c-449d-befb-6632ea8d9f51', 'df041c3a-59df-425f-8d80-ae0015381e54'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:29 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Delete snapshot completed successfully. Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3518ab24-0235-4f47-88c1-dd959c1383f3 tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-00467728-30b8-4e17-a1a5-255d5770ff55-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-32eb4514-42eb-419d-b8dd-f118f0342097-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-32eb4514-42eb-419d-b8dd-f118f0342097-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-quobyte-32eb4514-42eb-419d-b8dd-f118f0342097" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-32eb4514-42eb-419d-b8dd-f118f0342097" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Deleting offline snapshot 32eb4514-42eb-419d-b8dd-f118f0342097 of volume 47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] snapshot_file for this snap is: volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f05e05-17c3-47e1-8567-9f8b4f23e9ea]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:30 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 Apr 15 22:28:30 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:30 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097" returned: 0 in 0.457s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:30 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ca001-9290-4929-ac89-9c3a6a93238d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:30 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 Apr 15 22:28:30 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:30 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" returned: 0 in 0.459s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:30 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 Apr 15 22:28:30 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:31 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097" returned: 0 in 0.443s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:31 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097 Apr 15 22:28:31 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:31 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5.32eb4514-42eb-419d-b8dd-f118f0342097" returned: 0 in 0.399s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-32eb4514-42eb-419d-b8dd-f118f0342097" released by "_delete_snapshot" :: held 1.805s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" released by "delete_snapshot" :: held 1.815s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:31 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Created reservations ['9269c950-2903-4b61-8495-f506a23a37c3', '36ebcbfb-b947-40dc-bf57-3f0892525e43', '04aed46a-a29d-4701-bcb8-0b1e4d52286a', 'a156dedc-1074-4b4d-adb2-27ef50ab670f'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:31 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Delete snapshot completed successfully. Apr 15 22:28:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f5500b41-66e1-42ad-9eef-2d6983c9c9bd tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-32eb4514-42eb-419d-b8dd-f118f0342097-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9fb61-d67d-40b7-a09c-09d86f3fa045]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:32 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 Apr 15 22:28:32 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:32 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:32 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5 Apr 15 22:28:32 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:33 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" returned: 0 in 0.409s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-quobyte-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5" released by "delete_volume" :: held 0.925s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Created reservations ['c014714e-159c-4a06-b2b3-2cc01e0c0e4d', 'b0f8807d-a2ee-43f5-b368-c9db8bc24c65', 'fad88ea1-0d30-45c2-a653-17271665171c', '615d3e08-0e93-464f-9dde-69aa16a6ae84'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:33 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:33 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:33 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.466s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Deleted volume successfully. Apr 15 22:28:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-aed44aac-7c17-443b-9bbc-8b89b27914fb tempest-VolumesSnapshotListTestJSON-528149575 None] Lock "cinder-47f085f0-5bf0-4ba9-aaa3-6a8a60e01dc5-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (58f899dc-83a4-4be1-a4bf-0489f780888c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b4397c-03c0-43ac-8eed-756027db5cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b4397c-03c0-43ac-8eed-756027db5cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2147000649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc525e7-e0cf-4435-8d15-cb3b0eab76cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4d62777d854006a4282249fd9bb464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:40Z,use_quota=True,user_id='b97627f89b834f71a12f884d99e7d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43044c9b-0ef0-4d0c-8716-adf64d36869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43044c9b-0ef0-4d0c-8716-adf64d36869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b1c33f-a25c-4aec-8a5d-a9418dcb7a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b1c33f-a25c-4aec-8a5d-a9418dcb7a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc525e7-e0cf-4435-8d15-cb3b0eab76cb', 'volume_name': 'volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a265a6a0-cd46-4cf1-960d-c2ba8f71f721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a265a6a0-cd46-4cf1-960d-c2ba8f71f721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0e9759-0918-4afc-a063-5146698795ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Volume bbc525e7-e0cf-4435-8d15-cb3b0eab76cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb', 'volume_size': 1} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2147000649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc525e7-e0cf-4435-8d15-cb3b0eab76cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4d62777d854006a4282249fd9bb464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:40Z,use_quota=True,user_id='b97627f89b834f71a12f884d99e7d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Creating volume bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:40 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:40 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb 1073741824 Apr 15 22:28:40 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (5f0a4f4c-94b2-4ce7-9734-deec329b232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa806943-514f-47fe-87c7-c776022d8e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa806943-514f-47fe-87c7-c776022d8e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1719961832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f83461-49cb-4f5b-8cf4-b96374ef07b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:40Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a317ba8-86e2-401a-8038-a2c249e9fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a317ba8-86e2-401a-8038-a2c249e9fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0e833c-262a-4f75-b04b-d539f42a374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d0e833c-262a-4f75-b04b-d539f42a374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f83461-49cb-4f5b-8cf4-b96374ef07b5', 'volume_name': 'volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e78fe1-5472-4ceb-85e3-9c713b15a302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e78fe1-5472-4ceb-85e3-9c713b15a302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7987969e-46f4-4625-baec-e6d1d34ba46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume b2f83461-49cb-4f5b-8cf4-b96374ef07b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5', 'volume_size': 1} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (4ab64725-92b1-4d58-99c9-a762fd75e763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac32dac1-fefd-444f-abe3-6ce5a4085e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac32dac1-fefd-444f-abe3-6ce5a4085e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775115098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:40Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66db3ced-2bc7-4808-b689-a123ac450bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66db3ced-2bc7-4808-b689-a123ac450bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2fb24d-4407-434d-b09f-7bf2c3881040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2fb24d-4407-434d-b09f-7bf2c3881040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3', 'volume_name': 'volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a026bb-94d4-412f-a9e5-48f5a1573403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a026bb-94d4-412f-a9e5-48f5a1573403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7fadbb-25a8-4541-8eda-b45e3f0620f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Volume c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3', 'volume_size': 1} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (726d2523-387b-42f2-8513-ed4d9e9c7830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3dc6e3e-93b4-49a2-995f-f086d3e22e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3dc6e3e-93b4-49a2-995f-f086d3e22e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1867591397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1611f77-5e5e-4aad-9d1f-48f556e4759f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1adf3c3-4e6e-4665-a1a5-0fa054639000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1adf3c3-4e6e-4665-a1a5-0fa054639000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d8bfd2-a209-4a4b-993e-85f76d40623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d8bfd2-a209-4a4b-993e-85f76d40623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1611f77-5e5e-4aad-9d1f-48f556e4759f', 'volume_name': 'volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df0b062-8b59-424c-bc5f-1d32180bb434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df0b062-8b59-424c-bc5f-1d32180bb434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9026a948-1c65-48a1-8b21-249a56b39e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:40 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Volume c1611f77-5e5e-4aad-9d1f-48f556e4759f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f', 'volume_size': 1} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:40 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb 1073741824" returned: 0 in 0.623s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:40 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb Apr 15 22:28:41 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (7adc8e25-ada6-4a74-9318-5617de8fe328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf664af6-dfcb-42a2-98d2-a2df6eca1ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf664af6-dfcb-42a2-98d2-a2df6eca1ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084338593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1312b6e-e628-4bb7-89b9-3423fcdfb2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39401da0-448f-4e62-9603-4498ffdf8da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39401da0-448f-4e62-9603-4498ffdf8da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a070fb1f-bc69-4705-ad01-944144308d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a070fb1f-bc69-4705-ad01-944144308d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1312b6e-e628-4bb7-89b9-3423fcdfb2b7', 'volume_name': 'volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e9c9bf-7844-49b2-9d69-7628d492a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e9c9bf-7844-49b2-9d69-7628d492a63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aac2ada-6256-4782-a86e-9ef5ac6bf3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Volume c1312b6e-e628-4bb7-89b9-3423fcdfb2b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7', 'volume_size': 1} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (bf148d1c-3fa8-4b3e-8a38-c7b063df6721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5354c00-2560-4172-8ed5-ad7f952b9678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5354c00-2560-4172-8ed5-ad7f952b9678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982282695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55978bcd-7cb6-4973-a9bd-85be955e8cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017b0fb1-d692-4f94-b45b-4968a57f345c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017b0fb1-d692-4f94-b45b-4968a57f345c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4248c2-f49c-44ee-8d14-ab1316454217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4248c2-f49c-44ee-8d14-ab1316454217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55978bcd-7cb6-4973-a9bd-85be955e8cac', 'volume_name': 'volume-55978bcd-7cb6-4973-a9bd-85be955e8cac', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987fdab2-69cf-4838-8160-a5d7c2f8d1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987fdab2-69cf-4838-8160-a5d7c2f8d1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9804d40-99fb-49e3-a7c3-12d42693166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Volume 55978bcd-7cb6-4973-a9bd-85be955e8cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55978bcd-7cb6-4973-a9bd-85be955e8cac', 'volume_size': 1} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (a6c1383a-cc69-4d4c-9f75-721c89b553df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f520cd9-5659-40d0-a191-a02b03de8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f520cd9-5659-40d0-a191-a02b03de8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1510234062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1093428a-0ec4-4fe1-93ac-7234447c4c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dee5f5-c967-4f62-99b4-704d0b02e1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dee5f5-c967-4f62-99b4-704d0b02e1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c936a10c-5d7d-43f9-94cd-871b41f662f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c936a10c-5d7d-43f9-94cd-871b41f662f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1093428a-0ec4-4fe1-93ac-7234447c4c40', 'volume_name': 'volume-1093428a-0ec4-4fe1-93ac-7234447c4c40', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df19102-4ed6-4f94-8eb4-49d73ca34061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df19102-4ed6-4f94-8eb4-49d73ca34061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b3152a-224c-43cd-9ad2-758bed1c2811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Volume 1093428a-0ec4-4fe1-93ac-7234447c4c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1093428a-0ec4-4fe1-93ac-7234447c4c40', 'volume_size': 1} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:41 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" returned: 0 in 0.636s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.183s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1719961832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f83461-49cb-4f5b-8cf4-b96374ef07b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:40Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Creating volume b2f83461-49cb-4f5b-8cf4-b96374ef07b5 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:41 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0e9759-0918-4afc-a063-5146698795ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371ce288-23c9-4be5-9e57-eb817f45e1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:41 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 1073741824 Apr 15 22:28:41 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:41 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Volume volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb (bbc525e7-e0cf-4435-8d15-cb3b0eab76cb): created successfully Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (371ce288-23c9-4be5-9e57-eb817f45e1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:41 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (58f899dc-83a4-4be1-a4bf-0489f780888c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e9dd4e92-273e-479d-9656-8604beeb0d80 tempest-VolumeDependencyTests-831881530 None] Created volume successfully. Apr 15 22:28:42 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 1073741824" returned: 0 in 0.563s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:42 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 Apr 15 22:28:42 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:42 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5" returned: 0 in 0.499s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1775115098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:40Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Creating volume c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:42 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7987969e-46f4-4625-baec-e6d1d34ba46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:42 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 1073741824 Apr 15 22:28:42 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb52121-2666-4739-aa5d-d85073e5fec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:42 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 (b2f83461-49cb-4f5b-8cf4-b96374ef07b5): created successfully Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb52121-2666-4739-aa5d-d85073e5fec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:42 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (5f0a4f4c-94b2-4ce7-9734-deec329b232d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:42 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b0c98408-09ca-4ab1-ac9b-bbda73efd69b tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created volume successfully. Apr 15 22:28:43 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 1073741824" returned: 0 in 0.597s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:43 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 Apr 15 22:28:43 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:43 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.935s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1867591397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1611f77-5e5e-4aad-9d1f-48f556e4759f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Creating volume c1611f77-5e5e-4aad-9d1f-48f556e4759f {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:43 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a7fadbb-25a8-4541-8eda-b45e3f0620f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4699fa-04eb-4a18-92d6-0612f7e2b03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:43 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f 1073741824 Apr 15 22:28:43 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:43 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Volume volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 (c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3): created successfully Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4699fa-04eb-4a18-92d6-0612f7e2b03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:43 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (4ab64725-92b1-4d58-99c9-a762fd75e763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:43 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6d26b9ff-aa19-4d0b-a489-4c1ae95fcb6b tempest-CreateVolumesFromImageTest-1345645279 None] Created volume successfully. Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (1929e3a3-0c08-4927-8e6c-02c64e7c8e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309fec6a-72b5-4a6e-8c88-085a1b9845cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309fec6a-72b5-4a6e-8c88-085a1b9845cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1769176942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f59a68e-9a90-4db3-9aef-290f9f3b14b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:44Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bd5716-606f-4fdd-b954-70653c4f219d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bd5716-606f-4fdd-b954-70653c4f219d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8badb8b-9624-4efc-8780-a4c5526f82db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8badb8b-9624-4efc-8780-a4c5526f82db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f59a68e-9a90-4db3-9aef-290f9f3b14b4', 'volume_name': 'volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f84191-f35a-4b7d-b96a-de7f8237ff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f84191-f35a-4b7d-b96a-de7f8237ff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703c4817-7dcb-4a7d-943c-5c669a72bff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume 9f59a68e-9a90-4db3-9aef-290f9f3b14b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4', 'volume_size': 1} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (ee53e26a-efaf-4ed5-9c80-8fa923a966f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8347f02c-edcb-47d7-9e5b-ba1041808dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8347f02c-edcb-47d7-9e5b-ba1041808dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043995396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7068649-daec-4bdc-8bc8-ff3b0ac37739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:44Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2fa723-1abb-411b-90e8-ffbe39fcea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be2fa723-1abb-411b-90e8-ffbe39fcea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd870c-f511-4ab5-8db1-f1907283c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aefd870c-f511-4ab5-8db1-f1907283c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7068649-daec-4bdc-8bc8-ff3b0ac37739', 'volume_name': 'volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199cd328-46b7-45bc-bdf1-afdac1f0dcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199cd328-46b7-45bc-bdf1-afdac1f0dcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d260392-c811-46ed-b960-e26dabd1654d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume c7068649-daec-4bdc-8bc8-ff3b0ac37739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739', 'volume_size': 1} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (782d10ba-3fff-49e8-b239-45efa9008d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073140aa-f692-407d-8b8a-a82f39a893ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073140aa-f692-407d-8b8a-a82f39a893ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465209958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9540f7-f773-4d97-87a7-cda3985aa03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:44Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0cbb71-a672-4536-a72a-166a271e1e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f0cbb71-a672-4536-a72a-166a271e1e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f5ec55-2a35-417c-9515-a0858483392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f5ec55-2a35-417c-9515-a0858483392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec9540f7-f773-4d97-87a7-cda3985aa03c', 'volume_name': 'volume-ec9540f7-f773-4d97-87a7-cda3985aa03c', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f501bafa-d04d-4350-89cf-bf44ef689a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f501bafa-d04d-4350-89cf-bf44ef689a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7570ebbd-c406-4e38-a381-e726cd425363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume ec9540f7-f773-4d97-87a7-cda3985aa03c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec9540f7-f773-4d97-87a7-cda3985aa03c', 'volume_size': 1} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (1b7467d0-7298-4b53-95fc-5f55de01bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c785eb75-60e3-493a-b12a-259000a06e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c785eb75-60e3-493a-b12a-259000a06e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1408072399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722441d9-113a-4fd1-be48-078352d7ed23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:45Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ddcf73-1955-4da3-bdfd-9795f5640ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ddcf73-1955-4da3-bdfd-9795f5640ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a720bfb-03c0-4834-b732-cb6cdbe1d4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a720bfb-03c0-4834-b732-cb6cdbe1d4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722441d9-113a-4fd1-be48-078352d7ed23', 'volume_name': 'volume-722441d9-113a-4fd1-be48-078352d7ed23', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a26923-f249-4916-a0a9-51f5ff419642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85a26923-f249-4916-a0a9-51f5ff419642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0aaabc-f962-44a9-b8f7-4b69b429d59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume 722441d9-113a-4fd1-be48-078352d7ed23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722441d9-113a-4fd1-be48-078352d7ed23', 'volume_size': 1} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:44 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f 1073741824" returned: 0 in 1.025s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:44 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f Apr 15 22:28:44 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (d6d7e23d-7e2e-4c83-af8a-d2bba12ebb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68ae72b-4696-4a0d-9783-410afde8cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68ae72b-4696-4a0d-9783-410afde8cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197357916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9bd4b8-2a3a-4978-b148-a9101bd8eb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:45Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef48b84-d5a0-41e5-8352-64b3f1966707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef48b84-d5a0-41e5-8352-64b3f1966707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5214c5bd-eea7-4747-bf10-b520f0245acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5214c5bd-eea7-4747-bf10-b520f0245acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9bd4b8-2a3a-4978-b148-a9101bd8eb57', 'volume_name': 'volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c74bfd-db52-4900-8095-cd10b0e54336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c74bfd-db52-4900-8095-cd10b0e54336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c895606d-132d-4b34-9702-41e1fe72b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:44 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume 6e9bd4b8-2a3a-4978-b148-a9101bd8eb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57', 'volume_size': 1} Apr 15 22:28:44 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:45 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f" returned: 0 in 0.495s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.270s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084338593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1312b6e-e628-4bb7-89b9-3423fcdfb2b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Creating volume c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:45 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9026a948-1c65-48a1-8b21-249a56b39e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10ea417-cdd9-4f4d-b712-714cc0393487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:45 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 1073741824 Apr 15 22:28:45 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:45 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Volume volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f (c1611f77-5e5e-4aad-9d1f-48f556e4759f): created successfully Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10ea417-cdd9-4f4d-b712-714cc0393487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:45 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (726d2523-387b-42f2-8513-ed4d9e9c7830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:45 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-dc0350fc-2077-4af5-99c2-23ad76b1dd3b tempest-CreateVolumesFromImageTest-1345645279 None] Created volume successfully. Apr 15 22:28:46 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 1073741824" returned: 0 in 0.682s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:46 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 Apr 15 22:28:46 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:46 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7" returned: 0 in 0.446s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.226s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982282695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55978bcd-7cb6-4973-a9bd-85be955e8cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Creating volume 55978bcd-7cb6-4973-a9bd-85be955e8cac {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:46 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aac2ada-6256-4782-a86e-9ef5ac6bf3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:46 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac 1073741824 Apr 15 22:28:46 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d262c88d-4081-4c6a-899f-577abd725cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:46 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Volume volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 (c1312b6e-e628-4bb7-89b9-3423fcdfb2b7): created successfully Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d262c88d-4081-4c6a-899f-577abd725cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:46 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (7adc8e25-ada6-4a74-9318-5617de8fe328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:46 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-41d891d9-d7bc-4ca0-ae90-9e71cc471397 tempest-CreateVolumesFromImageTest-1345645279 None] Created volume successfully. Apr 15 22:28:47 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac 1073741824" returned: 0 in 0.602s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:47 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac Apr 15 22:28:47 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:47 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.130s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1510234062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1093428a-0ec4-4fe1-93ac-7234447c4c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcff9a19ea7e425c9d8c73b9489dcb0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:41Z,use_quota=True,user_id='00e45ad7591242c0b515ad4a6b58ac59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Creating volume 1093428a-0ec4-4fe1-93ac-7234447c4c40 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:47 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9804d40-99fb-49e3-a7c3-12d42693166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55978bcd-7cb6-4973-a9bd-85be955e8cac', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc5893c-0370-4c93-b866-d86b1f1cccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:47 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 1073741824 Apr 15 22:28:47 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:47 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Volume volume-55978bcd-7cb6-4973-a9bd-85be955e8cac (55978bcd-7cb6-4973-a9bd-85be955e8cac): created successfully Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc5893c-0370-4c93-b866-d86b1f1cccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:47 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (bf148d1c-3fa8-4b3e-8a38-c7b063df6721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:47 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2082f6bb-5015-47f6-8cf2-d8d387fb1a12 tempest-CreateVolumesFromImageTest-1345645279 None] Created volume successfully. Apr 15 22:28:48 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 1073741824" returned: 0 in 0.515s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:48 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 Apr 15 22:28:48 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:48 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40" returned: 0 in 0.456s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b3152a-224c-43cd-9ad2-758bed1c2811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1093428a-0ec4-4fe1-93ac-7234447c4c40', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfb4fa3-b5b0-4c3c-bdbc-cf59da5d667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Creating offline snapshot 2a3cb215-ea44-4db3-977d-6e41f558f243 of volume bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:28:48 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Volume volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 (1093428a-0ec4-4fe1-93ac-7234447c4c40): created successfully Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfb4fa3-b5b0-4c3c-bdbc-cf59da5d667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Flow 'volume_create_manager' (a6c1383a-cc69-4d4c-9f75-721c89b553df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea40376b-7109-4d35-90d6-a36f3c80350e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:48 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:48 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b48bcb66-c10d-4a6a-ab56-7d761be00420 tempest-CreateVolumesFromImageTest-1345645279 None] Created volume successfully. Apr 15 22:28:48 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb Apr 15 22:28:48 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:49 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" returned: 0 in 0.514s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:49 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 1G Apr 15 22:28:49 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-1093428a-0ec4-4fe1-93ac-7234447c4c40-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-1093428a-0ec4-4fe1-93ac-7234447c4c40-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-quobyte-1093428a-0ec4-4fe1-93ac-7234447c4c40" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-1093428a-0ec4-4fe1-93ac-7234447c4c40" acquired by "delete_volume" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0b629d-f94d-484b-b998-52d5591cdb1e]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:49 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 Apr 15 22:28:49 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:49 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 1G" returned: 0 in 0.542s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:49 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:49 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 Apr 15 22:28:49 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:50 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40" returned: 0 in 0.629s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:50 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40 Apr 15 22:28:50 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:50 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243" returned: 0 in 0.529s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:50 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 is being set with open permissions: ugo+rw Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:50 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 Apr 15 22:28:50 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:50 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-1093428a-0ec4-4fe1-93ac-7234447c4c40" returned: 0 in 0.537s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-1093428a-0ec4-4fe1-93ac-7234447c4c40" released by "delete_volume" :: held 1.196s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Created reservations ['eaa69464-c6aa-4bbe-8c8f-4e62a2ae1ef1', '964519c6-6ec5-47c7-a067-33d0d0799fca', '94789fcb-c846-4da1-b0f2-45dbf2697cd7', 'a696ab55-2a6e-4f99-ae20-6419d84c0fd4'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:50 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:50 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:50 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243" returned: 0 in 0.467s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:50 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:50 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.info Apr 15 22:28:50 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:51 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.442s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:51 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Deleted volume successfully. Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-26d699e8-9ade-462b-8113-4c3f2afc577f tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-1093428a-0ec4-4fe1-93ac-7234447c4c40-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:51 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.info" returned: 0 in 0.507s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:51 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.info is being set with open permissions: ugo+rw Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:51 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.info Apr 15 22:28:51 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-55978bcd-7cb6-4973-a9bd-85be955e8cac-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-55978bcd-7cb6-4973-a9bd-85be955e8cac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-quobyte-55978bcd-7cb6-4973-a9bd-85be955e8cac" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-55978bcd-7cb6-4973-a9bd-85be955e8cac" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f977546e-1f7d-4b74-b28d-db02a505e2be]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:51 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac Apr 15 22:28:51 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:51 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.info" returned: 0 in 0.481s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.123s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.611s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1769176942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f59a68e-9a90-4db3-9aef-290f9f3b14b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:44Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Creating volume 9f59a68e-9a90-4db3-9aef-290f9f3b14b4 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:51 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:51 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:51 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ba29fb75-777a-4350-a88e-92a9f01a5fa0 tempest-VolumeDependencyTests-831881530 None] Create snapshot completed successfully Apr 15 22:28:51 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 1073741824 Apr 15 22:28:51 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:52 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac" returned: 0 in 0.731s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:52 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac Apr 15 22:28:52 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:52 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 1073741824" returned: 0 in 0.699s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (950a9483-52c1-4f58-a180-4644f85e1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:52 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec499d32-dbf0-4416-96d5-498f23b154e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:52 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec499d32-dbf0-4416-96d5-498f23b154e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2115404628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4d62777d854006a4282249fd9bb464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2a3cb215-ea44-4db3-977d-6e41f558f243,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:52Z,use_quota=True,user_id='b97627f89b834f71a12f884d99e7d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ec615d-da59-40ab-a463-c3f8a6d0a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ec615d-da59-40ab-a463-c3f8a6d0a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c106f30-3572-45b5-b897-3a17210a6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c106f30-3572-45b5-b897-3a17210a6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6', 'volume_name': 'volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6', 'volume_size': 1, 'snapshot_id': '2a3cb215-ea44-4db3-977d-6e41f558f243'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27224b7-6760-4caf-8207-d79a76f453cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27224b7-6760-4caf-8207-d79a76f453cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df893bf9-6c87-446f-97e9-fec28d6e89b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:52 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Volume c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6', 'volume_size': 1, 'snapshot_id': '2a3cb215-ea44-4db3-977d-6e41f558f243'} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:52 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-55978bcd-7cb6-4973-a9bd-85be955e8cac" returned: 0 in 0.527s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-55978bcd-7cb6-4973-a9bd-85be955e8cac" released by "delete_volume" :: held 1.330s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:52 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Created reservations ['d2b294e6-144d-4273-85ba-d5337d533c5a', '0b659db8-8552-48d8-84a1-f2b83a49ee2a', '92445d76-3139-44cb-ad85-c6cff805db85', 'ee58e2f0-07a9-454b-8786-79bf691574ed'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:53 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:53 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:53 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4" returned: 0 in 0.600s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.799s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2043995396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7068649-daec-4bdc-8bc8-ff3b0ac37739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:44Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Creating volume c7068649-daec-4bdc-8bc8-ff3b0ac37739 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:53 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703c4817-7dcb-4a7d-943c-5c669a72bff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf001a8-cf76-4b24-8dbb-f7d4f457e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:53 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 1073741824 Apr 15 22:28:53 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:53 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 (9f59a68e-9a90-4db3-9aef-290f9f3b14b4): created successfully Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cf001a8-cf76-4b24-8dbb-f7d4f457e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (1929e3a3-0c08-4927-8e6c-02c64e7c8e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3b176a47-09d9-4951-b6a3-fecfa759735f tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created volume successfully. Apr 15 22:28:53 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.491s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:53 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Deleted volume successfully. Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-298dd523-4185-4e9a-946c-ef3af59060c9 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-55978bcd-7cb6-4973-a9bd-85be955e8cac-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Flow 'volume_create_manager' (e0abd1c4-e214-46cd-805e-6b7131556750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a4c530-8a93-41af-95b4-56f8e3ddc07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a4c530-8a93-41af-95b4-56f8e3ddc07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1975672630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5f3650bec64c70a56be14a42e41b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:54Z,use_quota=True,user_id='08a72247673f4a7899358a4d7f74e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc34a389-6101-4933-9d22-0f6fe9d20d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc34a389-6101-4933-9d22-0f6fe9d20d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0881659-9c74-43a1-ab84-6638b4e276bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0881659-9c74-43a1-ab84-6638b4e276bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b', 'volume_name': 'volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54291306-2985-474f-9044-e07a24698cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54291306-2985-474f-9044-e07a24698cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03e7232-6531-4938-b109-dbd75e4857c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:53 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Volume 38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b', 'volume_size': 1} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-quobyte-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2546a75-8c03-4319-a563-21ccdc8ab102]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:53 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 1073741824" returned: 0 in 0.689s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:53 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:53 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 Apr 15 22:28:53 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:53 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 Apr 15 22:28:53 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:54 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739" returned: 0 in 0.401s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.651s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-465209958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec9540f7-f773-4d97-87a7-cda3985aa03c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:44Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Creating volume ec9540f7-f773-4d97-87a7-cda3985aa03c {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:54 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:54 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d260392-c811-46ed-b960-e26dabd1654d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072a0c17-a812-46b9-a276-19d50d429159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:54 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c 1073741824 Apr 15 22:28:54 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7" returned: 0 in 0.482s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:54 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 (c7068649-daec-4bdc-8bc8-ff3b0ac37739): created successfully Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072a0c17-a812-46b9-a276-19d50d429159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (ee53e26a-efaf-4ed5-9c80-8fa923a966f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:54 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7 Apr 15 22:28:54 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:54 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-bf1e0fbf-beed-49ea-8826-196a13ed453d tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created volume successfully. Apr 15 22:28:54 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7" returned: 0 in 0.466s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7" released by "delete_volume" :: held 0.975s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:54 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c 1073741824" returned: 0 in 0.517s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Created reservations ['9e903f31-fe68-40ee-8d07-21f3e786c519', '3f4e4541-785c-4e9c-b4b2-dee35e70cf8d', 'f5a7b6a9-9239-41d6-a50c-5e7593b5b840', 'e45734df-11d9-4cd4-9b9d-6a65c1bf1a60'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:54 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c Apr 15 22:28:54 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:54 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:54 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:54 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:55 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c" returned: 0 in 0.404s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.411s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1408072399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722441d9-113a-4fd1-be48-078352d7ed23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:45Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Creating volume 722441d9-113a-4fd1-be48-078352d7ed23 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:55 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7570ebbd-c406-4e38-a381-e726cd425363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec9540f7-f773-4d97-87a7-cda3985aa03c', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8112b24d-3377-4f04-afd0-15556c47955c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:55 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 1073741824 Apr 15 22:28:55 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:55 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume volume-ec9540f7-f773-4d97-87a7-cda3985aa03c (ec9540f7-f773-4d97-87a7-cda3985aa03c): created successfully Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8112b24d-3377-4f04-afd0-15556c47955c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (782d10ba-3fff-49e8-b239-45efa9008d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-73e45276-dcf8-4620-a17a-3dc8014d3079 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created volume successfully. Apr 15 22:28:55 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.408s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:55 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Deleted volume successfully. Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-6acae82e-e543-4733-a00c-5e8bc55650a8 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-c1312b6e-e628-4bb7-89b9-3423fcdfb2b7-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:55 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 1073741824" returned: 0 in 0.513s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:55 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 Apr 15 22:28:55 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-c1611f77-5e5e-4aad-9d1f-48f556e4759f-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-c1611f77-5e5e-4aad-9d1f-48f556e4759f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-quobyte-c1611f77-5e5e-4aad-9d1f-48f556e4759f" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-c1611f77-5e5e-4aad-9d1f-48f556e4759f" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed54ecb0-cfb0-431d-9735-2e96883c1bbf]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:55 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:56 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f Apr 15 22:28:56 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:56 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23" returned: 0 in 0.436s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.210s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-197357916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9bd4b8-2a3a-4978-b148-a9101bd8eb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2fd42612534d2e911514478bb3e8ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:45Z,use_quota=True,user_id='4153985c47924b48a88859a2c72ae6a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Creating volume 6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:56 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0aaabc-f962-44a9-b8f7-4b69b429d59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722441d9-113a-4fd1-be48-078352d7ed23', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:56 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 1073741824 Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd69a9f-5bdc-479c-b8f0-4205800ee17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:56 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:56 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume volume-722441d9-113a-4fd1-be48-078352d7ed23 (722441d9-113a-4fd1-be48-078352d7ed23): created successfully Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd69a9f-5bdc-479c-b8f0-4205800ee17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (1b7467d0-7298-4b53-95fc-5f55de01bc60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:56 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-22ffdedb-ee0e-400e-949e-392885d788f7 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created volume successfully. Apr 15 22:28:56 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f" returned: 0 in 0.483s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:56 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f Apr 15 22:28:56 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:56 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 1073741824" returned: 0 in 0.506s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:56 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 Apr 15 22:28:56 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:56 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1611f77-5e5e-4aad-9d1f-48f556e4759f" returned: 0 in 0.437s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-c1611f77-5e5e-4aad-9d1f-48f556e4759f" released by "delete_volume" :: held 0.951s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Created reservations ['dcfdc06e-f906-4853-bf73-d8af353e147d', '4e456d5b-99ed-484f-b95f-4095108e97c4', 'd3a65db6-64fb-4329-8d1f-8c651bf02678', 'c3e42b1d-52c3-41d4-9cd0-a64f3048dc4f'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:56 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:57 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:57 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "cinder-quobyte-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[72887f7f-1c1d-4d68-84f1-aabfd1506894]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:57 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 Apr 15 22:28:57 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:57 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.567s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-2a3cb215-ea44-4db3-977d-6e41f558f243-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c895606d-132d-4b34-9702-41e1fe72b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a90dcbb-3512-49c5-bb15-d7e3dc5593ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-2a3cb215-ea44-4db3-977d-6e41f558f243-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Creating volume c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 from snapshot 2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:57 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Volume volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 (6e9bd4b8-2a3a-4978-b148-a9101bd8eb57): created successfully Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a90dcbb-3512-49c5-bb15-d7e3dc5593ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Flow 'volume_create_manager' (d6d7e23d-7e2e-4c83-af8a-d2bba12ebb81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] snapshot: 2a3cb215-ea44-4db3-977d-6e41f558f243, volume: c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:57 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-83d13823-f257-4930-9d03-cdd8b3175b01 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created volume successfully. Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aafad16-9ca8-42b8-8a03-4dfeade424cd]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:57 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 Apr 15 22:28:57 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:57 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.466s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:57 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Deleted volume successfully. Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8f5e0ce1-f480-400a-ba2b-e28ee4611334 tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-c1611f77-5e5e-4aad-9d1f-48f556e4759f-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:57 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3" returned: 0 in 0.509s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:57 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3 Apr 15 22:28:57 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:57 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243" returned: 0 in 0.481s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[94159e35-8b0c-45a5-9694-ef4a8675fafb]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:57 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb Apr 15 22:28:57 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-quobyte-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ba1095-8f52-41dc-a342-1ac4fd3e6e99]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:28:57 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:58 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 Apr 15 22:28:58 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:58 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3" returned: 0 in 0.475s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-quobyte-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3" released by "delete_volume" :: held 1.007s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Created reservations ['563b854b-e43a-4051-9d46-76a9e9a54b27', '57bb0202-0bbc-492d-a91f-2301c393b5ef', '8d6dda5e-d20a-44d6-b5ae-4a09d0010274', '59f18282-69b4-4733-8515-07f9530a1c89'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:58 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:58 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:58 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" returned: 0 in 0.581s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:58 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 Apr 15 22:28:58 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:58 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57" returned: 0 in 0.518s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:58 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57 Apr 15 22:28:58 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:28:58 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.472s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:28:58 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Deleted volume successfully. Apr 15 22:28:58 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-acc58f82-0306-4694-b884-675b4be9feca tempest-CreateVolumesFromImageTest-1345645279 None] Lock "cinder-c1d49a93-d5bd-4f1b-8b2a-8c8c611441b3-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:59 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57" released by "delete_volume" :: held 1.072s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created reservations ['62c43756-0459-4861-b40a-aa222061db13', 'ccfc0970-83ea-487e-818c-ee2e91415aac', 'dff41bef-6477-4be3-b223-5bd1267e0630', '9ad11b6b-65a9-43c3-a1e1-556f3dc46612'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:28:59 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:28:59 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:28:59 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-722441d9-113a-4fd1-be48-078352d7ed23-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-722441d9-113a-4fd1-be48-078352d7ed23-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-quobyte-722441d9-113a-4fd1-be48-078352d7ed23" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-722441d9-113a-4fd1-be48-078352d7ed23" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d297db-e19f-4093-81bc-d95b52e4b7a9]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:00 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 1.358s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:00 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Deleted volume successfully. Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-3b507b23-103b-42f4-9cb6-2b93bc4548d2 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-6e9bd4b8-2a3a-4978-b148-a9101bd8eb57-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:00 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 Apr 15 22:29:00 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:00 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" returned: 0 in 2.317s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec52a705-4ed8-40b5-ac64-ac49f02ee071]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:00 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:00 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb Apr 15 22:29:00 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:01 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23" returned: 0 in 0.744s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:01 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23 Apr 15 22:29:01 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:01 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" returned: 0 in 0.633s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb, size 1024.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:29:01 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Converted 1024.00 MB image at 441.72 MB/s Apr 15 22:29:01 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 is being set with open permissions: ugo+rw Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:01 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 Apr 15 22:29:01 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:01 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-722441d9-113a-4fd1-be48-078352d7ed23" returned: 0 in 0.498s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-722441d9-113a-4fd1-be48-078352d7ed23" released by "delete_volume" :: held 1.282s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created reservations ['64bce467-8a01-41c2-a2f0-eee4627effb2', 'e76073a8-755a-4f43-8b32-6926a42592c1', '9e045f56-319d-4166-b78d-99895f61f534', '677f05e9-755a-4006-8ea5-d6962e33b26d'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:01 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:01 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:01 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" returned: 0 in 0.458s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" released by "_copy_volume_from_snapshot" :: held 4.524s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-2a3cb215-ea44-4db3-977d-6e41f558f243-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" released by "_create_volume_from_snapshot" :: held 4.550s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.580s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.024s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1975672630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5f3650bec64c70a56be14a42e41b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:28:54Z,use_quota=True,user_id='08a72247673f4a7899358a4d7f74e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Creating volume 38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:01 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:01 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b 1073741824 Apr 15 22:29:01 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df893bf9-6c87-446f-97e9-fec28d6e89b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6', 'volume_size': 1, 'snapshot_id': '2a3cb215-ea44-4db3-977d-6e41f558f243'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b58a6b-741f-4235-ae78-4789e5a0223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:01 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Volume volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 (c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6): created successfully Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b58a6b-741f-4235-ae78-4789e5a0223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (950a9483-52c1-4f58-a180-4644f85e1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:01 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c86bee3c-cb11-4675-97d2-04b5027633fe tempest-VolumeDependencyTests-831881530 None] Created volume successfully. Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (8dfb6c5c-446f-44b2-9609-7fb2c0ae3419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:01 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d445d4-4ab0-4953-8e7b-c08519e374bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-2a3cb215-ea44-4db3-977d-6e41f558f243-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37d445d4-4ab0-4953-8e7b-c08519e374bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-214668582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e4217a-7aa2-49ce-a49d-32f86b45e45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:02Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcad16f9-f25d-49dd-a25d-f09c4ff818f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcad16f9-f25d-49dd-a25d-f09c4ff818f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3fada6-cdf3-42c0-93f8-d0d3ed151883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3fada6-cdf3-42c0-93f8-d0d3ed151883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e4217a-7aa2-49ce-a49d-32f86b45e45a', 'volume_name': 'volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a973bbf-4fbd-4a3b-a325-fddb1f17e63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a973bbf-4fbd-4a3b-a325-fddb1f17e63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abd7014-9001-49d9-9fad-c3dc5c75db12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:02 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume c6e4217a-7aa2-49ce-a49d-32f86b45e45a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a', 'volume_size': 1} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Lock "cinder-2a3cb215-ea44-4db3-977d-6e41f558f243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-2a3cb215-ea44-4db3-977d-6e41f558f243" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-2a3cb215-ea44-4db3-977d-6e41f558f243" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Deleting offline snapshot 2a3cb215-ea44-4db3-977d-6e41f558f243 of volume bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] snapshot_file for this snap is: volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d74b0-ae2a-4e46-8e6d-f67a4ab59999]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:02 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 Apr 15 22:29:02 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:02 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.511s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:02 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Deleted volume successfully. Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c8f30e67-f9dd-44dd-ac2d-c5430ef341b9 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-722441d9-113a-4fd1-be48-078352d7ed23-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:02 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b 1073741824" returned: 0 in 0.590s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:02 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b Apr 15 22:29:02 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:02 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243" returned: 0 in 0.522s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[58877446-8fd6-413c-a6be-ae9e09f9451c]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-ec9540f7-f773-4d97-87a7-cda3985aa03c-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-ec9540f7-f773-4d97-87a7-cda3985aa03c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-quobyte-ec9540f7-f773-4d97-87a7-cda3985aa03c" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-ec9540f7-f773-4d97-87a7-cda3985aa03c" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1537bf0-e176-4e35-bf49-7b1dc8f601bc]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:02 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb Apr 15 22:29:02 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:02 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c Apr 15 22:29:02 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:02 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" returned: 0 in 0.422s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-214668582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e4217a-7aa2-49ce-a49d-32f86b45e45a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:02Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Creating volume c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:02 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03e7232-6531-4938-b109-dbd75e4857c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:02 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a 1073741824 Apr 15 22:29:02 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd72b2c3-ac3e-4a90-b29a-8d2230b44a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:02 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Volume volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b (38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b): created successfully Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd72b2c3-ac3e-4a90-b29a-8d2230b44a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:02 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Flow 'volume_create_manager' (e0abd1c4-e214-46cd-805e-6b7131556750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:02 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9c44376f-3bbd-4bcd-ab1c-a6ba850ebae3 tempest-SnapshotDependencyTests-1808976189 None] Created volume successfully. Apr 15 22:29:03 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" returned: 0 in 0.524s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:03 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 Apr 15 22:29:03 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:03 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c" returned: 0 in 0.522s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:03 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c Apr 15 22:29:03 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:03 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a 1073741824" returned: 0 in 0.582s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:03 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a Apr 15 22:29:03 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:03 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243" returned: 0 in 0.555s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:03 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-ec9540f7-f773-4d97-87a7-cda3985aa03c" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-ec9540f7-f773-4d97-87a7-cda3985aa03c" released by "delete_volume" :: held 1.034s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:03 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243 Apr 15 22:29:03 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created reservations ['1bec67e3-4bd9-4618-8e8f-50f8041a236a', 'ebcf1057-e0b9-423b-a92b-beee06fe142c', '889bae12-f1f3-4d3d-b750-ed770a5899bf', '36ed2590-c4c5-4cfd-a723-415c716df371'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:03 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:03 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:03 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" returned: 0 in 0.432s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.316s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3abd7014-9001-49d9-9fad-c3dc5c75db12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9156b533-1da7-4fd9-acf7-c28ae6c3af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Creating offline snapshot 8fb561cc-8a86-4e50-a267-89026ffdfea1 of volume 38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:29:03 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a (c6e4217a-7aa2-49ce-a49d-32f86b45e45a): created successfully Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9156b533-1da7-4fd9-acf7-c28ae6c3af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (8dfb6c5c-446f-44b2-9609-7fb2c0ae3419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[649bd7bb-2d79-4a40-a4ac-2fac823a8eb6]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:03 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:03 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fdb6a504-3c70-4e80-8a41-fca33bbd82c9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created volume successfully. Apr 15 22:29:04 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b Apr 15 22:29:04 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:04 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb.2a3cb215-ea44-4db3-977d-6e41f558f243" returned: 0 in 0.492s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-2a3cb215-ea44-4db3-977d-6e41f558f243" released by "_delete_snapshot" :: held 2.146s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" released by "delete_snapshot" :: held 2.155s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:04 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.443s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Deleted volume successfully. Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Created reservations ['00a4a12b-a423-4196-a020-25db6bf45b83', '914bb762-d675-4856-885e-eab970a5e7e8', '568e02e5-6a30-44f9-a7f7-078b83576894', '668b68ae-2746-4174-8f39-7422484757a3'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-ba1f5a69-25e2-414a-a4a2-38aad1eaefac tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-ec9540f7-f773-4d97-87a7-cda3985aa03c-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:04 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Delete snapshot completed successfully. Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-116d8ca2-a95b-4c32-80a6-1792904561cb tempest-VolumeDependencyTests-831881530 None] Lock "cinder-2a3cb215-ea44-4db3-977d-6e41f558f243-delete_snapshot" released by "delete_snapshot" :: held 2.238s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:04 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" returned: 0 in 0.615s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:04 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 1G Apr 15 22:29:04 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-c7068649-daec-4bdc-8bc8-ff3b0ac37739-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-c7068649-daec-4bdc-8bc8-ff3b0ac37739-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-quobyte-c7068649-daec-4bdc-8bc8-ff3b0ac37739" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-c7068649-daec-4bdc-8bc8-ff3b0ac37739" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[69676f38-d93b-442a-a966-f3afc346122d]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:04 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:04 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 Apr 15 22:29:04 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:05 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 1G" returned: 0 in 0.498s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:05 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 Apr 15 22:29:05 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca60cd4-4bae-4ca3-8d55-5c6d7836b54a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:05 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb Apr 15 22:29:05 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:05 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739" returned: 0 in 0.516s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:05 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739 Apr 15 22:29:05 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:05 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1" returned: 0 in 0.505s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:05 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 is being set with open permissions: ugo+rw Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:05 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 Apr 15 22:29:05 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:05 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:05 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb Apr 15 22:29:05 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:05 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7068649-daec-4bdc-8bc8-ff3b0ac37739" returned: 0 in 0.429s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-c7068649-daec-4bdc-8bc8-ff3b0ac37739" released by "delete_volume" :: held 0.975s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created reservations ['bec8dac2-dd74-4e79-bfd4-7e26543314a7', 'ecf7497b-8275-4909-81c3-4416f3ecc6eb', '080751d7-65bc-4371-918e-8344151d752f', '5651a8c0-c633-4bc5-a84f-8682e66f7c08'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:05 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:05 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-9f59a68e-9a90-4db3-9aef-290f9f3b14b4-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-9f59a68e-9a90-4db3-9aef-290f9f3b14b4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-quobyte-9f59a68e-9a90-4db3-9aef-290f9f3b14b4" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-9f59a68e-9a90-4db3-9aef-290f9f3b14b4" acquired by "delete_volume" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9833c6de-e6f0-4e89-868c-2355fcf20a3f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:05 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:05 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1" returned: 0 in 0.450s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:06 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.info Apr 15 22:29:06 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:06 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 Apr 15 22:29:06 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:06 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" returned: 0 in 0.479s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb" released by "delete_volume" :: held 1.002s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Created reservations ['a5aa9575-7811-45ce-b585-c8284fdda7f2', '5ce27cc5-cd1d-498c-a6e2-2765778651cb', '01efe44a-e807-4851-b0f7-e62a7dbe811d', 'b441cf2e-17ea-4286-9e09-785b8d0b534c'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:06 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:06 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:06 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:06 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Deleted volume successfully. Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-346b4cd1-517c-4039-93cf-a7f09aeec368 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-c7068649-daec-4bdc-8bc8-ff3b0ac37739-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:06 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.info" returned: 0 in 0.447s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.info is being set with open permissions: ugo+rw Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:06 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.info Apr 15 22:29:06 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:06 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4" returned: 0 in 0.530s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:06 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4 Apr 15 22:29:06 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:06 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.467s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:06 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Deleted volume successfully. Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-13a84f8d-4700-4b06-90ee-5f712fcdd065 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-bbc525e7-e0cf-4435-8d15-cb3b0eab76cb-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:06 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.info" returned: 0 in 0.412s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.717s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Creating offline snapshot bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c of volume c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:29:06 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-276aea61-4639-4237-8d7d-ca2fa7bb3939 tempest-SnapshotDependencyTests-1808976189 None] Create snapshot completed successfully Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ac7839-28ed-4dc9-9271-a364abcc1e5a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:06 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-9f59a68e-9a90-4db3-9aef-290f9f3b14b4" returned: 0 in 0.443s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-9f59a68e-9a90-4db3-9aef-290f9f3b14b4" released by "delete_volume" :: held 0.998s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:06 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created reservations ['01d26edf-a715-4709-b5de-2b3824cb25f9', 'e9f6c852-005b-4005-95ff-f188a99777a0', '6df482db-9b2d-4e2e-8e3c-df6b9c2420eb', 'ea942627-0d1b-4a99-ada4-56d60e2df050'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:06 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a Apr 15 22:29:06 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:07 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:07 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:07 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" returned: 0 in 0.469s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:07 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c 1G Apr 15 22:29:07 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:07 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.440s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:07 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Deleted volume successfully. Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-54b2bde7-6615-4ca3-b618-1f6f14e1b68c tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-9f59a68e-9a90-4db3-9aef-290f9f3b14b4-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (8738463c-297b-41eb-a316-f9cfb443f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84ca2a4-040d-4fc1-8859-1aeaf0eb64eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84ca2a4-040d-4fc1-8859-1aeaf0eb64eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-333838705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29c7cef-db6c-406c-b096-90e7a82c29cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4d62777d854006a4282249fd9bb464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:08Z,use_quota=True,user_id='b97627f89b834f71a12f884d99e7d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510aed09-1d7a-4fe4-8d7f-0d4cea50d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510aed09-1d7a-4fe4-8d7f-0d4cea50d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454dad7f-6330-47c6-ae8f-ed07a0859f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454dad7f-6330-47c6-ae8f-ed07a0859f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a29c7cef-db6c-406c-b096-90e7a82c29cb', 'volume_name': 'volume-a29c7cef-db6c-406c-b096-90e7a82c29cb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f404910f-60f8-4143-8ca8-52e1fe2bef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f404910f-60f8-4143-8ca8-52e1fe2bef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffc484b-4ab6-4b01-a130-716fe2676d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:07 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Volume a29c7cef-db6c-406c-b096-90e7a82c29cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a29c7cef-db6c-406c-b096-90e7a82c29cb', 'volume_size': 1} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:07 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c 1G" returned: 0 in 0.567s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:07 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:07 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c Apr 15 22:29:07 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-b2f83461-49cb-4f5b-8cf4-b96374ef07b5-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Flow 'volume_create_manager' (f3c4c7d9-eca3-42f0-a99d-7f5a7bb0556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b14a71d-914d-421f-8a64-cc09ab3f76c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-b2f83461-49cb-4f5b-8cf4-b96374ef07b5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b14a71d-914d-421f-8a64-cc09ab3f76c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbe3859-abee-4a5c-b69e-093a8dc3d8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb5f3650bec64c70a56be14a42e41b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8fb561cc-8a86-4e50-a267-89026ffdfea1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:08Z,use_quota=True,user_id='08a72247673f4a7899358a4d7f74e8ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738dd6f1-c6cc-4b69-bfc6-034e7ae59fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738dd6f1-c6cc-4b69-bfc6-034e7ae59fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bcd599-fc0d-4a6d-8e52-7d2170ad4fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bcd599-fc0d-4a6d-8e52-7d2170ad4fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cfbe3859-abee-4a5c-b69e-093a8dc3d8af', 'volume_name': 'volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af', 'volume_size': 1, 'snapshot_id': '8fb561cc-8a86-4e50-a267-89026ffdfea1'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53130cb-938c-4868-a25c-cab2bfbf1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53130cb-938c-4868-a25c-cab2bfbf1a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17beeb0b-8454-4061-8fad-8d41d1f71b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:08 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Volume cfbe3859-abee-4a5c-b69e-093a8dc3d8af: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af', 'volume_size': 1, 'snapshot_id': '8fb561cc-8a86-4e50-a267-89026ffdfea1'} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "cinder-quobyte-b2f83461-49cb-4f5b-8cf4-b96374ef07b5" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-b2f83461-49cb-4f5b-8cf4-b96374ef07b5" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790ecfe-4a84-4042-afcc-d8a94a14d880]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:08 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 Apr 15 22:29:08 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:08 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" returned: 0 in 0.484s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:08 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c is being set with open permissions: ugo+rw Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:08 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c Apr 15 22:29:08 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:08 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5" returned: 0 in 0.488s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:08 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5 Apr 15 22:29:08 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:08 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" returned: 0 in 0.423s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:08 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:08 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.info Apr 15 22:29:08 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:09 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-b2f83461-49cb-4f5b-8cf4-b96374ef07b5" returned: 0 in 0.426s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-quobyte-b2f83461-49cb-4f5b-8cf4-b96374ef07b5" released by "delete_volume" :: held 0.941s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Created reservations ['69e7675c-6736-49a7-b4a2-300ec830fef8', '399bf4e9-a2e2-40e7-91da-18687d477754', 'cf64a66d-e9c9-4636-823e-5eefdcde7b87', '39e1aae2-78cb-4df2-a718-75f1a86128ce'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:SELECT=131,cinder:INSERT=51,cinder:UPDATE=178,cinder:DELETE=15 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=191,cinder:SELECT=154,cinder:INSERT=40,cinder:DELETE=19 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:09 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:09 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:09 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.info" returned: 0 in 0.446s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:09 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.info is being set with open permissions: ugo+rw Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:09 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.info Apr 15 22:29:09 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:09 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.408s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Deleted volume successfully. Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-d2c889d9-dd12-4e66-bc3f-98335e3b5a51 tempest-CreateVolumesFromSourceVolumeTest-1875304645 None] Lock "cinder-b2f83461-49cb-4f5b-8cf4-b96374ef07b5-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:09 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.info" returned: 0 in 0.427s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.879s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-333838705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a29c7cef-db6c-406c-b096-90e7a82c29cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4d62777d854006a4282249fd9bb464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:08Z,use_quota=True,user_id='b97627f89b834f71a12f884d99e7d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Creating volume a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:09 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:09 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:09 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb 1073741824 Apr 15 22:29:09 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:09 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-424289a1-0424-43ad-88d9-4db479611c6e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Create snapshot completed successfully Apr 15 22:29:10 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb 1073741824" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:10 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb Apr 15 22:29:10 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (5e079b4d-fc0e-44ef-91ee-256556aa4273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71317fe1-1b29-4bd4-b6ad-b34f8484fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71317fe1-1b29-4bd4-b6ad-b34f8484fb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801535953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205c3f15-4cae-499d-98bb-af0c34e0841b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a1ce0b-02e9-4f6c-a4a1-aba67249a43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a1ce0b-02e9-4f6c-a4a1-aba67249a43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55682589-bafb-4052-80e7-0583210edb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55682589-bafb-4052-80e7-0583210edb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '205c3f15-4cae-499d-98bb-af0c34e0841b', 'volume_name': 'volume-205c3f15-4cae-499d-98bb-af0c34e0841b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b4fbea-a9c8-4a42-90e8-58e8336a5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b4fbea-a9c8-4a42-90e8-58e8336a5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab97418a-2e80-40f4-816d-499c399797b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume 205c3f15-4cae-499d-98bb-af0c34e0841b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-205c3f15-4cae-499d-98bb-af0c34e0841b', 'volume_size': 1} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:10 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb" returned: 0 in 0.560s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.661s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-quobyte-8fb561cc-8a86-4e50-a267-89026ffdfea1-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" by "_create_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (5778475c-b904-4161-b05c-d45104ae207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee107736-360b-4d2e-a430-4566bf380996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffc484b-4ab6-4b01-a130-716fe2676d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a29c7cef-db6c-406c-b096-90e7a82c29cb', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aaa2910-cb9d-4e58-b755-1a29502bcf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee107736-360b-4d2e-a430-4566bf380996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85436664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d21203-4308-4961-92cb-4d7c99623428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66077fd4-5d63-40ef-a156-c04dd5bbabb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66077fd4-5d63-40ef-a156-c04dd5bbabb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad34a84-1a64-4f9c-9d1f-f4017fe78340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad34a84-1a64-4f9c-9d1f-f4017fe78340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7d21203-4308-4961-92cb-4d7c99623428', 'volume_name': 'volume-c7d21203-4308-4961-92cb-4d7c99623428', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0a39ac-3fa0-4da4-b6e7-a2e6829213e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0a39ac-3fa0-4da4-b6e7-a2e6829213e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2581a80-4b2d-4228-a7f4-67e370ccb4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume c7d21203-4308-4961-92cb-4d7c99623428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7d21203-4308-4961-92cb-4d7c99623428', 'volume_size': 1} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:10 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Volume volume-a29c7cef-db6c-406c-b096-90e7a82c29cb (a29c7cef-db6c-406c-b096-90e7a82c29cb): created successfully Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aaa2910-cb9d-4e58-b755-1a29502bcf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (8738463c-297b-41eb-a316-f9cfb443f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-8fb561cc-8a86-4e50-a267-89026ffdfea1-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" acquired by "_create_volume_from_snapshot" :: waited 0.096s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Creating volume cfbe3859-abee-4a5c-b69e-093a8dc3d8af from snapshot 8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-quobyte-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:10 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e103b537-2a2d-447c-97f4-90ff8594bf00 tempest-VolumeDependencyTests-831881530 None] Created volume successfully. Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] snapshot: 8fb561cc-8a86-4e50-a267-89026ffdfea1, volume: cfbe3859-abee-4a5c-b69e-093a8dc3d8af, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:10 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[933c4f4c-2c89-45f2-b9c0-402817d0c98b]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (1b853136-f3ed-4cf5-8e01-8469f7629bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c12b0cc-594e-46a1-944f-291cd34cbdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c12b0cc-594e-46a1-944f-291cd34cbdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592153632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfec1ac6-2b87-480b-a59e-5f8952d07008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff1b0bb-08dc-4e54-942d-c7a3b3a2bfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff1b0bb-08dc-4e54-942d-c7a3b3a2bfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6677ade7-7982-4675-8157-64b02bfd461b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6677ade7-7982-4675-8157-64b02bfd461b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfec1ac6-2b87-480b-a59e-5f8952d07008', 'volume_name': 'volume-dfec1ac6-2b87-480b-a59e-5f8952d07008', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6048811-81d0-4213-9ab2-e375d677bd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 Apr 15 22:29:11 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6048811-81d0-4213-9ab2-e375d677bd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15dc5259-dafa-4acd-bd14-f3d6db4f3385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume dfec1ac6-2b87-480b-a59e-5f8952d07008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfec1ac6-2b87-480b-a59e-5f8952d07008', 'volume_size': 1} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (03e9b40f-bc9b-46b0-b5b5-f775aec61455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d5fb9-7e4e-49d6-a778-9d41a83b95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868d5fb9-7e4e-49d6-a778-9d41a83b95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981890145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec663d0-e6e0-4f53-9fac-d2583c815dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8cf429-6ecd-4dda-8aa0-3b35d00c23bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8cf429-6ecd-4dda-8aa0-3b35d00c23bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5b2a1d-1239-428e-93da-cef4e0be3cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb5b2a1d-1239-428e-93da-cef4e0be3cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec663d0-e6e0-4f53-9fac-d2583c815dcf', 'volume_name': 'volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df3ae6c-4fc1-40bf-8cab-54a49165ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df3ae6c-4fc1-40bf-8cab-54a49165ecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92750b3f-f8ef-4211-a6dc-cee0b16406d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume cec663d0-e6e0-4f53-9fac-d2583c815dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf', 'volume_size': 1} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (0435baaf-1185-4464-8eea-4272361c1270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a92c648-e841-4e88-a361-84d22d29f870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a92c648-e841-4e88-a361-84d22d29f870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632134828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e13a08e-7016-4085-a0f5-318bc40977ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:12Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58261afc-7e92-42f1-8c18-91ea29db73d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58261afc-7e92-42f1-8c18-91ea29db73d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a213c3ad-3169-48dd-883d-b0d28a5adbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a213c3ad-3169-48dd-883d-b0d28a5adbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e13a08e-7016-4085-a0f5-318bc40977ba', 'volume_name': 'volume-8e13a08e-7016-4085-a0f5-318bc40977ba', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c47b20c-3666-4056-92fb-6c57af0bdd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c47b20c-3666-4056-92fb-6c57af0bdd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6475f-d967-4b9b-945d-8caa8cfdebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:11 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume 8e13a08e-7016-4085-a0f5-318bc40977ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e13a08e-7016-4085-a0f5-318bc40977ba', 'volume_size': 1} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:11 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1" returned: 0 in 0.645s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97329a3-addf-4921-b7bd-7794a04d3392]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:11 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:11 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b Apr 15 22:29:11 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Flow 'volume_create_manager' (1a92bf6c-814a-440e-bc01-88fa7cd3c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ebee9c-d8b8-4a07-84fe-febc35a37956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ebee9c-d8b8-4a07-84fe-febc35a37956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6c87c17f484b4f8d3650ac1f3c7835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:12Z,use_quota=True,user_id='55ce8878d9f84efd8d9fc06a2b207932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c2cc92-becf-4555-9c97-7911c5abd341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c2cc92-becf-4555-9c97-7911c5abd341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d407bac-8d2a-47c5-89c8-8d743b52bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d407bac-8d2a-47c5-89c8-8d743b52bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1', 'volume_name': 'volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24e451d-f7a8-4e7f-bd82-ddb50e7f08c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24e451d-f7a8-4e7f-bd82-ddb50e7f08c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04063f3-2ae6-4de3-9ded-8222b3da2b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Volume 8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1', 'volume_size': 1} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:12 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (b8dc5694-bc3b-4962-a3c1-2e3031e3194c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e3e061-9fb2-4cfe-b540-35aca53eb3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" returned: 0 in 0.520s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e3e061-9fb2-4cfe-b540-35aca53eb3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2008292391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3761b548-35b4-437f-ac33-4071ca738046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac4d62777d854006a4282249fd9bb464',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a29c7cef-db6c-406c-b096-90e7a82c29cb,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:12Z,use_quota=True,user_id='b97627f89b834f71a12f884d99e7d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af Apr 15 22:29:12 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68628995-8f78-4184-88c1-2c6a8f21d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68628995-8f78-4184-88c1-2c6a8f21d596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361fc93d-eb8c-4d35-9c22-3d9a1cb6cb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361fc93d-eb8c-4d35-9c22-3d9a1cb6cb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3761b548-35b4-437f-ac33-4071ca738046', 'volume_name': 'volume-3761b548-35b4-437f-ac33-4071ca738046', 'volume_size': 1, 'source_volid': 'a29c7cef-db6c-406c-b096-90e7a82c29cb', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf4b20d-70b8-472a-a4b4-ac8dd9f5226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf4b20d-70b8-472a-a4b4-ac8dd9f5226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a041751-6cee-412d-93db-de71da99fea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:12 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Volume 3761b548-35b4-437f-ac33-4071ca738046: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3761b548-35b4-437f-ac33-4071ca738046', 'volume_size': 1, 'source_volid': 'a29c7cef-db6c-406c-b096-90e7a82c29cb', 'source_volstatus': 'available'} Apr 15 22:29:12 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:14 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" returned: 0 in 2.041s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:14 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4daa58-b0e1-420d-b3ec-ac9dd94c2ce7]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:14 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b Apr 15 22:29:14 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:14 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" returned: 0 in 0.586s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:14 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:29:14 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Converted 1024.00 MB image at 501.54 MB/s Apr 15 22:29:14 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af is being set with open permissions: ugo+rw Apr 15 22:29:14 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:14 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af Apr 15 22:29:14 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:15 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" returned: 0 in 0.428s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" released by "_copy_volume_from_snapshot" :: held 4.280s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-8fb561cc-8a86-4e50-a267-89026ffdfea1-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" released by "_create_volume_from_snapshot" :: held 4.304s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.402s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.608s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801535953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=205c3f15-4cae-499d-98bb-af0c34e0841b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Creating volume 205c3f15-4cae-499d-98bb-af0c34e0841b {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:15 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:15 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b 1073741824 Apr 15 22:29:15 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17beeb0b-8454-4061-8fad-8d41d1f71b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af', 'volume_size': 1, 'snapshot_id': '8fb561cc-8a86-4e50-a267-89026ffdfea1'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63646a6a-5519-4919-b4dd-7b3b187a741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:15 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Volume volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af (cfbe3859-abee-4a5c-b69e-093a8dc3d8af): created successfully Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63646a6a-5519-4919-b4dd-7b3b187a741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Flow 'volume_create_manager' (f3c4c7d9-eca3-42f0-a99d-7f5a7bb0556e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:15 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-22893f4b-4ffc-416d-b7a1-063234c39813 tempest-SnapshotDependencyTests-1808976189 None] Created volume successfully. Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-8fb561cc-8a86-4e50-a267-89026ffdfea1-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-8fb561cc-8a86-4e50-a267-89026ffdfea1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-quobyte-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-quobyte-8fb561cc-8a86-4e50-a267-89026ffdfea1" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-8fb561cc-8a86-4e50-a267-89026ffdfea1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Deleting offline snapshot 8fb561cc-8a86-4e50-a267-89026ffdfea1 of volume 38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] snapshot_file for this snap is: volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6418e23-803a-458a-bde5-9f4fec464347]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:15 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 Apr 15 22:29:15 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:15 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b 1073741824" returned: 0 in 0.529s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:15 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:15 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b Apr 15 22:29:15 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:16 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1" returned: 0 in 0.500s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cda8a7c-aa3b-4dad-8c32-b5d5c73ba4be]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:16 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b Apr 15 22:29:16 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:16 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b" returned: 0 in 0.436s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.332s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-85436664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7d21203-4308-4961-92cb-4d7c99623428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Creating volume c7d21203-4308-4961-92cb-4d7c99623428 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:16 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab97418a-2e80-40f4-816d-499c399797b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-205c3f15-4cae-499d-98bb-af0c34e0841b', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acd87c2-84c3-4ac0-8b4b-7efa28405380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:16 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 1073741824 Apr 15 22:29:16 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:16 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume volume-205c3f15-4cae-499d-98bb-af0c34e0841b (205c3f15-4cae-499d-98bb-af0c34e0841b): created successfully Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7acd87c2-84c3-4ac0-8b4b-7efa28405380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (5e079b4d-fc0e-44ef-91ee-256556aa4273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:16 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-13935752-48f4-4a52-8fce-168de6aac4fa tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created volume successfully. Apr 15 22:29:16 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" returned: 0 in 0.486s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:16 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 Apr 15 22:29:16 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:16 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 1073741824" returned: 0 in 0.535s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:16 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:16 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 Apr 15 22:29:16 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:17 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1" returned: 0 in 0.496s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:17 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1 Apr 15 22:29:17 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:17 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428" returned: 0 in 0.427s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.165s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-592153632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfec1ac6-2b87-480b-a59e-5f8952d07008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Creating volume dfec1ac6-2b87-480b-a59e-5f8952d07008 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:17 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2581a80-4b2d-4228-a7f4-67e370ccb4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7d21203-4308-4961-92cb-4d7c99623428', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6999ddbe-0f13-4658-8416-2473afdb2075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:17 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 1073741824 Apr 15 22:29:17 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:17 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume volume-c7d21203-4308-4961-92cb-4d7c99623428 (c7d21203-4308-4961-92cb-4d7c99623428): created successfully Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6999ddbe-0f13-4658-8416-2473afdb2075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (5778475c-b904-4161-b05c-d45104ae207d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:17 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-4feead5b-422c-46eb-b8e2-1bb4c1839059 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created volume successfully. Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_service.periodic_task [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81921) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:17 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:17 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:17 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b.8fb561cc-8a86-4e50-a267-89026ffdfea1" returned: 0 in 0.437s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-8fb561cc-8a86-4e50-a267-89026ffdfea1" released by "_delete_snapshot" :: held 1.977s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" released by "delete_snapshot" :: held 2.001s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Created reservations ['a1404965-1419-4051-a413-3305d5d0ea13', 'bb785f23-04ec-485b-ab3f-a877ea940eb3', '62d0cf7f-3727-4153-bf6b-7e334ddc1922', '5d60ae22-d315-49c2-9942-e892d7fc7fa8'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:17 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Delete snapshot completed successfully. Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-9e671321-2d5d-4e1b-9392-7a5eace9e68b tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-8fb561cc-8a86-4e50-a267-89026ffdfea1-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:17 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 1073741824" returned: 0 in 0.495s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:17 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.451s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:17 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-6d24778e-e3f1-4eac-bbfb-b20c54c5fcbe None None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:17 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 Apr 15 22:29:17 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:18 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008" returned: 0 in 0.473s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.932s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981890145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec663d0-e6e0-4f53-9fac-d2583c815dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:11Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Creating volume cec663d0-e6e0-4f53-9fac-d2583c815dcf {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:18 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15dc5259-dafa-4acd-bd14-f3d6db4f3385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfec1ac6-2b87-480b-a59e-5f8952d07008', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad5655-2cd6-40f0-8538-702549cb2cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:18 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf 1073741824 Apr 15 22:29:18 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:18 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 (dfec1ac6-2b87-480b-a59e-5f8952d07008): created successfully Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad5655-2cd6-40f0-8538-702549cb2cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (1b853136-f3ed-4cf5-8e01-8469f7629bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:18 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f40ce9ea-f5bd-4d1c-b0d9-626cf3bb2be2 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created volume successfully. Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-quobyte-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcb58c3-07fd-490e-9a1d-c90c5ea5a633]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:18 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b Apr 15 22:29:18 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:18 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf 1073741824" returned: 0 in 0.564s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:18 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:18 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf Apr 15 22:29:18 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:19 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" returned: 0 in 0.515s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:19 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b Apr 15 22:29:19 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:19 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf" returned: 0 in 0.434s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.704s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632134828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e13a08e-7016-4085-a0f5-318bc40977ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7da8d35c3e84ac28764437ca237d98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:12Z,use_quota=True,user_id='821f39b72fd34bd9a214c23e2aef997b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Creating volume 8e13a08e-7016-4085-a0f5-318bc40977ba {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:19 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92750b3f-f8ef-4211-a6dc-cee0b16406d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1307ce50-6e8b-48f6-8f4d-c47f4337f45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:19 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba 1073741824 Apr 15 22:29:19 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:19 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf (cec663d0-e6e0-4f53-9fac-d2583c815dcf): created successfully Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1307ce50-6e8b-48f6-8f4d-c47f4337f45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (03e9b40f-bc9b-46b0-b5b5-f775aec61455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:19 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-83292784-71d5-404d-bff5-0e587fdaa6a9 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created volume successfully. Apr 15 22:29:19 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" returned: 0 in 0.438s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b" released by "delete_volume" :: held 0.984s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Created reservations ['823f8b07-5852-4a50-b0e1-df3b212e937d', '1d3bae08-bc0c-4977-a1ef-7d7d9620fde1', '95d2646e-8739-43c3-8862-49f62815187b', '0f79abb9-97a1-426e-9a1c-cd84c1ba40f2'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:19 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:19 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-cfbe3859-abee-4a5c-b69e-093a8dc3d8af-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-cfbe3859-abee-4a5c-b69e-093a8dc3d8af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "cinder-quobyte-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4988ea1-f4e0-48ce-9809-132febfc8326]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:19 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba 1073741824" returned: 0 in 0.579s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:19 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:19 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba Apr 15 22:29:19 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:19 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af Apr 15 22:29:19 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:20 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.448s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:20 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Deleted volume successfully. Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-00b3cba0-e94e-47a3-8d7c-2f83e8708444 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-38469e76-8bd9-4b24-ae4e-a5b9b2c12f4b-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:20 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba" returned: 0 in 0.431s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.218s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:20 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6c87c17f484b4f8d3650ac1f3c7835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:12Z,use_quota=True,user_id='55ce8878d9f84efd8d9fc06a2b207932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Creating volume 8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:20 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" returned: 0 in 0.513s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a6475f-d967-4b9b-945d-8caa8cfdebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e13a08e-7016-4085-a0f5-318bc40977ba', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dade07f6-8e5a-4cca-adb0-0d4c9c6fd1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:20 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 1073741824 Apr 15 22:29:20 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:20 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Volume volume-8e13a08e-7016-4085-a0f5-318bc40977ba (8e13a08e-7016-4085-a0f5-318bc40977ba): created successfully Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dade07f6-8e5a-4cca-adb0-0d4c9c6fd1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:20 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af Apr 15 22:29:20 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Flow 'volume_create_manager' (0435baaf-1185-4464-8eea-4272361c1270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:20 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1f036dc4-2de1-4e9f-a1d3-74c800e1c324 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created volume successfully. Apr 15 22:29:20 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 1073741824" returned: 0 in 0.476s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:20 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" returned: 0 in 0.455s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-quobyte-cfbe3859-abee-4a5c-b69e-093a8dc3d8af" released by "delete_volume" :: held 1.003s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:20 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 Apr 15 22:29:20 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Created reservations ['22eca3ce-222f-4693-a161-9adad4fb2369', '0ace4ad1-d715-4a94-ada5-98152cb39553', 'acfcf986-86bd-4f45-9503-2358a42e32c0', '6f615f00-f604-41ef-8c8b-2a50b2f1ef36'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:20 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:20 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:20 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-8e13a08e-7016-4085-a0f5-318bc40977ba-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-8e13a08e-7016-4085-a0f5-318bc40977ba-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:21 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-8e13a08e-7016-4085-a0f5-318bc40977ba" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1" returned: 0 in 0.441s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.054s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:21 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Cloning volume a29c7cef-db6c-406c-b096-90e7a82c29cb to volume 3761b548-35b4-437f-ac33-4071ca738046 Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04063f3-2ae6-4de3-9ded-8222b3da2b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384bfdbf-cb57-456e-835c-d34518fcb113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-8e13a08e-7016-4085-a0f5-318bc40977ba" acquired by "delete_volume" :: waited 0.034s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:21 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Volume volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 (8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1): created successfully Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (384bfdbf-cb57-456e-835c-d34518fcb113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Flow 'volume_create_manager' (1a92bf6c-814a-440e-bc01-88fa7cd3c63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7810e00-96ba-4e70-b99b-b6688c28bffd]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Creating offline snapshot 98ade51d-88d4-48e7-b8d6-3d2da7f8986a of volume a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:29:21 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b66ead28-1819-497e-9415-f34ead5ea572 tempest-CinderUnicodeTest-994650738 None] Created volume successfully. Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab18881-a43c-4ff9-b23f-67fb2ad89138]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:21 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.469s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:21 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Deleted volume successfully. Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c10635a0-f0fe-490f-83fc-d84f6cb034f7 tempest-SnapshotDependencyTests-1808976189 None] Lock "cinder-cfbe3859-abee-4a5c-b69e-093a8dc3d8af-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:21 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba Apr 15 22:29:21 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:21 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb Apr 15 22:29:21 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81921) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Flow 'volume_create_manager' (ed1e3c1f-e4c4-4bd4-9bdc-efb1bfc71556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e4c8b2-50ac-4640-9dce-1e63e73ffd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e4c8b2-50ac-4640-9dce-1e63e73ffd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2012028450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12043da2-3596-4350-b2a2-090fd3808d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6c87c17f484b4f8d3650ac1f3c7835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:22Z,use_quota=True,user_id='55ce8878d9f84efd8d9fc06a2b207932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6181268-a939-40b0-a5ba-c01d02c47b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6181268-a939-40b0-a5ba-c01d02c47b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88870107-6114-443f-ba05-f6baee2393b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88870107-6114-443f-ba05-f6baee2393b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12043da2-3596-4350-b2a2-090fd3808d7c', 'volume_name': 'volume-12043da2-3596-4350-b2a2-090fd3808d7c', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c774e034-00f5-4e72-a4ca-ccc2d8460812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c774e034-00f5-4e72-a4ca-ccc2d8460812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061ed4df-f602-4fd5-be30-9701c768a7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:21 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Volume 12043da2-3596-4350-b2a2-090fd3808d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12043da2-3596-4350-b2a2-090fd3808d7c', 'volume_size': 1} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:21 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb" returned: 0 in 0.564s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:21 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba" returned: 0 in 0.611s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:21 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:21 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a 1G Apr 15 22:29:21 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:21 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba Apr 15 22:29:21 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:22 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8e13a08e-7016-4085-a0f5-318bc40977ba" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-8e13a08e-7016-4085-a0f5-318bc40977ba" released by "delete_volume" :: held 1.136s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:22 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a 1G" returned: 0 in 0.548s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29c7cef-db6c-406c-b096-90e7a82c29cb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:22 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29c7cef-db6c-406c-b096-90e7a82c29cb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a Apr 15 22:29:22 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created reservations ['5dbe9abd-e932-4d33-b92b-380cf30dbaa5', 'c01db6eb-d920-4b86-adc8-9127b9489b6e', '2103caa8-5e32-4ae2-bcb6-826cdf2d7d03', 'f899b568-687b-4b63-8f66-a5bbba569c97'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:22 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:22 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:22 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a29c7cef-db6c-406c-b096-90e7a82c29cb -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a" returned: 0 in 0.489s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:22 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a is being set with open permissions: ugo+rw Apr 15 22:29:22 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:23 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a Apr 15 22:29:23 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:23 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.454s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:23 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Deleted volume successfully. Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-bc651761-aec0-47de-82cc-4fd9df7277f6 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-8e13a08e-7016-4085-a0f5-318bc40977ba-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-cec663d0-e6e0-4f53-9fac-d2583c815dcf-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-cec663d0-e6e0-4f53-9fac-d2583c815dcf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-cec663d0-e6e0-4f53-9fac-d2583c815dcf" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-cec663d0-e6e0-4f53-9fac-d2583c815dcf" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:23 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a" returned: 0 in 0.499s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0decb00-aa5b-4baa-985c-323775d31a41]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:23 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:23 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.info Apr 15 22:29:23 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:23 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf Apr 15 22:29:23 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:24 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.info" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:24 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.info is being set with open permissions: ugo+rw Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:24 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.info Apr 15 22:29:24 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:24 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf" returned: 0 in 0.569s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:24 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf Apr 15 22:29:24 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:24 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-cec663d0-e6e0-4f53-9fac-d2583c815dcf" returned: 0 in 0.497s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-cec663d0-e6e0-4f53-9fac-d2583c815dcf" released by "delete_volume" :: held 1.096s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:24 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.info" returned: 0 in 0.580s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-3761b548-35b4-437f-ac33-4071ca738046" by "_copy_volume_from_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-3761b548-35b4-437f-ac33-4071ca738046" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] snapshot: 98ade51d-88d4-48e7-b8d6-3d2da7f8986a, volume: 3761b548-35b4-437f-ac33-4071ca738046, {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3604ee2-d3ad-4f63-9782-84a7d40ff84b]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created reservations ['6c8b13d1-100d-4c91-904c-1cd3e22a3a6e', '79839690-35ff-4536-ad8d-9bbc1fe0567f', '7b67b385-7eb4-4127-aacc-295d8d7fc7b7', 'd835ee0a-cfae-466d-ae8b-c4a42d691697'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:24 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:24 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a Apr 15 22:29:24 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:24 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:24 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:25 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.433s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:25 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Deleted volume successfully. Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-39001009-fc7d-4e2b-8e3e-7b4ed5e016c8 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-cec663d0-e6e0-4f53-9fac-d2583c815dcf-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:25 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a" returned: 0 in 0.549s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a29c7cef-db6c-406c-b096-90e7a82c29cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Creating direct copy from snapshot {{(pid=81921) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b6a20-3897-4a49-8ddf-e8cd200739f0]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:25 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb Apr 15 22:29:25 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-dfec1ac6-2b87-480b-a59e-5f8952d07008-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-dfec1ac6-2b87-480b-a59e-5f8952d07008-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-dfec1ac6-2b87-480b-a59e-5f8952d07008" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-dfec1ac6-2b87-480b-a59e-5f8952d07008" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[c749a86e-1dc8-4116-bd4f-6db6d9fb5aca]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:25 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb" returned: 0 in 0.537s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG cinder.utils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Path /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 not found in is_blk_device check {{(pid=81921) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 22:29:25 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:25 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 Apr 15 22:29:25 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:25 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 Apr 15 22:29:25 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:26 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008" returned: 0 in 0.658s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:26 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:26 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008 Apr 15 22:29:26 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:28 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046" returned: 0 in 2.292s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f37285-7307-4d21-bc7a-5ccc34ca9107]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:28 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-dfec1ac6-2b87-480b-a59e-5f8952d07008" returned: 0 in 1.724s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-dfec1ac6-2b87-480b-a59e-5f8952d07008" released by "delete_volume" :: held 2.415s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created reservations ['16f6c322-ce4f-4374-b423-71bd520952a9', '2528f1f7-c99a-4703-97a2-93545b2b5649', 'cffdfc80-2fb9-447f-b45c-2beb16bd16ce', 'b8f750b6-5bd2-4619-b764-c9357f467cbb'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:28 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb Apr 15 22:29:28 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:28 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:28 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:28 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.467s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:28 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Deleted volume successfully. Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-07819e41-8e8e-44fc-a213-02502988f99c tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-dfec1ac6-2b87-480b-a59e-5f8952d07008-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:28 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb" returned: 0 in 0.687s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG cinder.image.image_utils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Image conversion details: src /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 {{(pid=81921) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 22:29:28 devstack cinder-volume[81921]: INFO cinder.image.image_utils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Converted 1024.00 MB image at 446.45 MB/s Apr 15 22:29:28 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 is being set with open permissions: ugo+rw Apr 15 22:29:28 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:28 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 Apr 15 22:29:28 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-c7d21203-4308-4961-92cb-4d7c99623428-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-c7d21203-4308-4961-92cb-4d7c99623428-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-c7d21203-4308-4961-92cb-4d7c99623428" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-c7d21203-4308-4961-92cb-4d7c99623428" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec549ca-f111-47be-a2bb-300a0393af9f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:29 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 Apr 15 22:29:29 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:29 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046" returned: 0 in 0.476s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-3761b548-35b4-437f-ac33-4071ca738046" released by "_copy_volume_from_snapshot" :: held 4.602s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-98ade51d-88d4-48e7-b8d6-3d2da7f8986a" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-98ade51d-88d4-48e7-b8d6-3d2da7f8986a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Deleting offline snapshot 98ade51d-88d4-48e7-b8d6-3d2da7f8986a of volume a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] snapshot_file for this snap is: volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[585f75c3-f383-4a90-935b-c36214ee2619]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:29 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a Apr 15 22:29:29 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:29 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428" returned: 0 in 0.534s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:29 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428 Apr 15 22:29:29 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:29 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a" returned: 0 in 0.544s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a29c7cef-db6c-406c-b096-90e7a82c29cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fef909-8c83-4e28-90e3-7fc3305d1b68]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:29 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:29 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb Apr 15 22:29:29 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:30 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c7d21203-4308-4961-92cb-4d7c99623428" returned: 0 in 0.406s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-c7d21203-4308-4961-92cb-4d7c99623428" released by "delete_volume" :: held 0.964s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created reservations ['0f2a0bdc-e269-44bf-a644-5a0a547b0500', '814d9a00-64b3-481f-97f5-44d238ca964c', '1a009cef-4a16-4b38-9538-c2ccdb40ef3b', 'cb7d7c3e-432b-4965-9edd-5816905776ab'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:30 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:30 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-205c3f15-4cae-499d-98bb-af0c34e0841b-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-205c3f15-4cae-499d-98bb-af0c34e0841b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-205c3f15-4cae-499d-98bb-af0c34e0841b" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-205c3f15-4cae-499d-98bb-af0c34e0841b" acquired by "delete_volume" :: waited 0.008s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[20911bfd-b47d-4e92-be0a-dcb23795243a]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:30 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b Apr 15 22:29:30 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:30 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb" returned: 0 in 0.540s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:30 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a Apr 15 22:29:30 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:30 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.425s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:30 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Deleted volume successfully. Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-f374bd85-7848-4ceb-b1d9-b7b7bfa92519 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-c7d21203-4308-4961-92cb-4d7c99623428-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:30 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b" returned: 0 in 0.515s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:30 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b Apr 15 22:29:30 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:30 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a" returned: 0 in 0.475s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:30 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:30 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a Apr 15 22:29:30 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:31 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-205c3f15-4cae-499d-98bb-af0c34e0841b" returned: 0 in 0.415s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-205c3f15-4cae-499d-98bb-af0c34e0841b" released by "delete_volume" :: held 0.953s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created reservations ['0c5cb8ed-6b60-4ec6-8c91-a8113cbd0eb3', '117ced96-29c2-4341-8791-15758417d4b5', '80303332-a94f-4e71-85ce-e731baa52078', '17029602-6adb-4acd-ad85-0741bd525dbc'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:31 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb.98ade51d-88d4-48e7-b8d6-3d2da7f8986a" returned: 0 in 0.423s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:31 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-98ade51d-88d4-48e7-b8d6-3d2da7f8986a" released by "_delete_snapshot" :: held 2.038s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:31 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.998s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.387s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T20:29:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2012028450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12043da2-3596-4350-b2a2-090fd3808d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e6c87c17f484b4f8d3650ac1f3c7835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T20:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T20:29:22Z,use_quota=True,user_id='55ce8878d9f84efd8d9fc06a2b207932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b),volume_type_id=f81c2d97-3cd4-49ec-b77a-f3aa5cdfa46b)}" {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Creating volume 12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Selected osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 as target Quobyte volume. {{(pid=81921) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 22:29:31 devstack cinder-volume[81921]: INFO cinder.volume.drivers.remotefs [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] casted to osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6 Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c 1073741824 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a041751-6cee-412d-93db-de71da99fea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3761b548-35b4-437f-ac33-4071ca738046', 'volume_size': 1, 'source_volid': 'a29c7cef-db6c-406c-b096-90e7a82c29cb', 'source_volstatus': 'available'}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8169fce-06a6-46b9-bab1-05d68b148506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:31 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c 1073741824 Apr 15 22:29:31 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:31 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Volume volume-3761b548-35b4-437f-ac33-4071ca738046 (3761b548-35b4-437f-ac33-4071ca738046): created successfully Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8169fce-06a6-46b9-bab1-05d68b148506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Flow 'volume_create_manager' (b8dc5694-bc3b-4962-a3c1-2e3031e3194c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" acquired by "delete_snapshot" :: waited 0.059s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Deleting offline snapshot bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c of volume c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] snapshot_file for this snap is: volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:29:31 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8b33442d-bec5-430a-84ec-6b84b05397c7 tempest-VolumeDependencyTests-831881530 None] Created volume successfully. Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb11c902-1ebf-46cc-bd53-b8e70b55f365]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:31 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c Apr 15 22:29:31 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:31 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.413s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:31 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Deleted volume successfully. Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-55c53cbb-88c7-4257-8478-b48ac55e9d9f tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-205c3f15-4cae-499d-98bb-af0c34e0841b-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:31 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c 1073741824" returned: 0 in 0.536s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:31 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" returned: 0 in 0.492s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f96e7a4-9677-4357-98c9-cb8bae61b160]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:31 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:31 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c Apr 15 22:29:31 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:31 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a Apr 15 22:29:31 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-a29c7cef-db6c-406c-b096-90e7a82c29cb-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-a29c7cef-db6c-406c-b096-90e7a82c29cb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-a29c7cef-db6c-406c-b096-90e7a82c29cb" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-a29c7cef-db6c-406c-b096-90e7a82c29cb" acquired by "delete_volume" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7987db6d-c11e-42e1-bf0f-356935990099]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:32 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c" returned: 0 in 0.473s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'} {{(pid=81921) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061ed4df-f602-4fd5-be30-9701c768a7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12043da2-3596-4350-b2a2-090fd3808d7c', 'volume_size': 1}' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da71830-c15f-4eb7-bf4e-995a984242f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 22:29:32 devstack cinder-volume[81921]: INFO cinder.volume.flows.manager.create_volume [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Volume volume-12043da2-3596-4350-b2a2-090fd3808d7c (12043da2-3596-4350-b2a2-090fd3808d7c): created successfully Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da71830-c15f-4eb7-bf4e-995a984242f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81921) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Flow 'volume_create_manager' (ed1e3c1f-e4c4-4bd4-9bdc-efb1bfc71556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81921) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 22:29:32 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb Apr 15 22:29:32 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:32 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-a16bef18-411b-4d65-8c17-7643fdf61bb9 tempest-CinderUnicodeTest-994650738 None] Created volume successfully. Apr 15 22:29:32 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" returned: 0 in 0.534s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:32 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c Apr 15 22:29:32 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Creating offline snapshot edefb411-a086-44f0-a67b-e9e2efbb4ee6 of volume 12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[815bc74a-64ad-4202-b9a6-4c23f5d3f3f9]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:32 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c Apr 15 22:29:32 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:32 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb" returned: 0 in 0.540s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:32 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb Apr 15 22:29:32 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:32 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" returned: 0 in 0.480s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:32 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:32 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c Apr 15 22:29:32 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:33 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c" returned: 0 in 0.503s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 1G {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:33 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 1G Apr 15 22:29:33 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:33 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-a29c7cef-db6c-406c-b096-90e7a82c29cb" returned: 0 in 0.439s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-a29c7cef-db6c-406c-b096-90e7a82c29cb" released by "delete_volume" :: held 1.009s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:33 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Created reservations ['faf6314a-438b-4b38-81b4-99d005cd5aff', '3b03d8d9-9b8b-4208-98f0-a673dfa79846', '17870e72-d05e-4529-b5b9-1910ff5ec77e', '4509a2f9-43a1-4798-8e8c-5c8847b305a4'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a.bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" returned: 0 in 0.447s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c" released by "_delete_snapshot" :: held 2.020s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" released by "delete_snapshot" :: held 2.038s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:33 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:33 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created reservations ['a01a9963-9ccf-4b11-a3a2-ea4f9b460baf', 'c7b773e9-8567-4baf-a880-dacbd2c53737', '3e808f0f-12cd-497e-8413-3dece300fefd', '82991218-f9fb-4a0b-a1f9-5835c55d27f9'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Delete snapshot completed successfully. Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-c4320975-51fa-4462-bcb8-5b5d3af1c10e tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-bc0cfe1b-89ee-4a5e-b6a9-5a22bfd9554c-delete_snapshot" released by "delete_snapshot" :: held 2.211s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:33 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 1G" returned: 0 in 0.554s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12043da2-3596-4350-b2a2-090fd3808d7c -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:33 devstack sudo[90654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12043da2-3596-4350-b2a2-090fd3808d7c -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 Apr 15 22:29:33 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:33 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.435s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:33 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Deleted volume successfully. Apr 15 22:29:33 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-b5aa186c-44a2-42d2-9c1d-f74895fdbdc4 tempest-VolumeDependencyTests-831881530 None] Lock "cinder-a29c7cef-db6c-406c-b096-90e7a82c29cb-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:34 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12043da2-3596-4350-b2a2-090fd3808d7c -F qcow2 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6" returned: 0 in 0.418s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:34 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 is being set with open permissions: ugo+rw Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:34 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 Apr 15 22:29:34 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-3761b548-35b4-437f-ac33-4071ca738046-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Lock "cinder-3761b548-35b4-437f-ac33-4071ca738046-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-3761b548-35b4-437f-ac33-4071ca738046" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-c6e4217a-7aa2-49ce-a49d-32f86b45e45a-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-c6e4217a-7aa2-49ce-a49d-32f86b45e45a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-3761b548-35b4-437f-ac33-4071ca738046" acquired by "delete_volume" :: waited 0.025s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dafce19-d80a-4ae2-b72e-c7ec702d2880]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "cinder-quobyte-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48ba4e4-07e9-4d0d-85ce-c08142ec3773]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:34 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 Apr 15 22:29:34 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:34 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6" returned: 0 in 0.456s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:34 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a Apr 15 22:29:34 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:34 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:34 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.info Apr 15 22:29:34 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:35 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046" returned: 0 in 0.490s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:35 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046 Apr 15 22:29:35 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:35 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" returned: 0 in 0.495s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:35 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a Apr 15 22:29:35 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:35 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.info" returned: 0 in 0.449s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:35 devstack cinder-volume[81921]: WARNING cinder.volume.drivers.remotefs [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.info is being set with open permissions: ugo+rw Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.info {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:35 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.info Apr 15 22:29:35 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:35 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-3761b548-35b4-437f-ac33-4071ca738046" returned: 0 in 0.419s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-3761b548-35b4-437f-ac33-4071ca738046" released by "delete_volume" :: held 0.937s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Created reservations ['4020c0b4-c905-4859-b715-c8a48bf37d81', '8f7da9d2-89f7-43bd-9d51-5ae34a0affc9', '46e90206-880c-482d-aebc-78c92b38ce66', '55d4c58a-4c53-4ea9-8d5b-6927ffd3403e'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:35 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" returned: 0 in 0.444s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-quobyte-c6e4217a-7aa2-49ce-a49d-32f86b45e45a" released by "delete_volume" :: held 0.968s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:35 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.info" returned: 0 in 0.451s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:35 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:35 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Created reservations ['c0f5d3fd-e0f0-4c14-bc73-0fe3b579d469', 'e94ef2c9-8622-4810-b1d0-b4a33e3827d6', '0d21bd32-f6b1-497a-823b-a6bf02bce484', 'cefdebe2-3363-4ae1-a089-580b0fc31264'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:35 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-fb6ec180-9a83-4a74-bd37-dfd32c019aa3 tempest-CinderUnicodeTest-994650738 None] Create snapshot completed successfully Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Lock "cinder-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Acquiring lock "cinder-quobyte-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[74652931-e898-4a90-862d-7e591fc3e639]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:35 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:35 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:35 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 Apr 15 22:29:35 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Acquiring lock "cinder-edefb411-a086-44f0-a67b-e9e2efbb4ee6-delete_snapshot" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Lock "cinder-edefb411-a086-44f0-a67b-e9e2efbb4ee6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Acquiring lock "cinder-quobyte-12043da2-3596-4350-b2a2-090fd3808d7c" by "delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-12043da2-3596-4350-b2a2-090fd3808d7c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Acquiring lock "cinder-quobyte-edefb411-a086-44f0-a67b-e9e2efbb4ee6" by "_delete_snapshot" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-edefb411-a086-44f0-a67b-e9e2efbb4ee6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Deleting offline snapshot edefb411-a086-44f0-a67b-e9e2efbb4ee6 of volume 12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] snapshot_file for this snap is: volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 {{(pid=81921) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff97959-54c5-48de-80c8-5a025fd7080f]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:35 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:35 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 Apr 15 22:29:35 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:36 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.519s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:36 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Deleted volume successfully. Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e485f417-29d6-46d4-b2c5-f7ecde4468ba tempest-VolumeDependencyTests-831881530 None] Lock "cinder-3761b548-35b4-437f-ac33-4071ca738046-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:36 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.404s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:36 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Deleted volume successfully. Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-1c5360d0-9fce-426b-b38f-db1f46015295 tempest-CreateVolumesFromSnapshotTest-1682717955 None] Lock "cinder-c6e4217a-7aa2-49ce-a49d-32f86b45e45a-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:36 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" returned: 0 in 0.531s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:36 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6 Apr 15 22:29:36 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:36 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6" returned: 0 in 0.520s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.remotefs [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12043da2-3596-4350-b2a2-090fd3808d7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81921) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[8194e5cd-44a4-4e4a-b9bb-08dac2707471]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:36 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c Apr 15 22:29:36 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:36 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" returned: 0 in 0.421s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Lock "cinder-quobyte-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6" released by "delete_volume" :: held 0.985s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Created reservations ['3d9edb90-328f-432e-b79e-185b401ab24e', '162e8cf3-c558-49a8-88be-34f4a04d4744', '1bfffe69-4572-476d-81f7-a8daac60d7c6', 'f0862ef1-fff7-4636-8722-6587d1074b45'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:36 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:36 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:36 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c" returned: 0 in 0.518s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:36 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:36 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 Apr 15 22:29:36 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:37 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.485s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:37 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Deleted volume successfully. Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-8392d790-4f2d-4f24-83af-1dc09d123a1b tempest-VolumeDependencyTests-831881530 None] Lock "cinder-c3614b47-a6a0-4ba4-9e57-bdfd10fde3d6-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:37 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6" returned: 0 in 0.560s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:37 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6 Apr 15 22:29:37 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:37 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c.edefb411-a086-44f0-a67b-e9e2efbb4ee6" returned: 0 in 0.426s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-edefb411-a086-44f0-a67b-e9e2efbb4ee6" released by "_delete_snapshot" :: held 2.088s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-12043da2-3596-4350-b2a2-090fd3808d7c" released by "delete_snapshot" :: held 2.098s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:37 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Created reservations ['0f5ab62d-067e-402e-bd96-4123f90afd50', '71af2f76-f914-4177-82b6-14476ad49b84', '45a9f6a2-994c-4e20-b460-e8d6f9ac8168', 'dd0c4de1-8cd8-404e-a616-6da1fac837c0'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:38 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Delete snapshot completed successfully. Apr 15 22:29:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-2713d109-6301-4d8b-b57f-f2dd92167bce tempest-CinderUnicodeTest-994650738 None] Lock "cinder-edefb411-a086-44f0-a67b-e9e2efbb4ee6-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "cinder-12043da2-3596-4350-b2a2-090fd3808d7c-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:38 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-12043da2-3596-4350-b2a2-090fd3808d7c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "cinder-quobyte-12043da2-3596-4350-b2a2-090fd3808d7c" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-12043da2-3596-4350-b2a2-090fd3808d7c" acquired by "delete_volume" :: waited 0.006s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[7259dfe5-1414-4fff-930c-d0c4a4a85652]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:39 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c Apr 15 22:29:39 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:39 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c" returned: 0 in 0.461s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:39 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c Apr 15 22:29:39 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:39 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-12043da2-3596-4350-b2a2-090fd3808d7c" returned: 0 in 0.398s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-12043da2-3596-4350-b2a2-090fd3808d7c" released by "delete_volume" :: held 0.886s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Created reservations ['4845f3c4-c0df-4232-9894-9fdf7666bc41', 'adc1cbf8-7a8d-4fc6-9245-911fc552dc0f', '7ce54478-ce31-4913-b8ba-2e2032de3b3d', '9f05ee93-2044-49d2-a661-42a15ffb9980'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:39 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:39 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:39 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "cinder-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1-delete_volume" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "cinder-quobyte-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1" by "delete_volume" {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1" acquired by "delete_volume" :: waited 0.014s {{(pid=81921) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a15f788-bc5e-43dc-8d9c-052f05d89103]: (4, 'qcow2') {{(pid=82892) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:40 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 Apr 15 22:29:40 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:40 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.438s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:40 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Deleted volume successfully. Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-e5895969-a801-46ee-931b-ceebfed87de6 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-12043da2-3596-4350-b2a2-090fd3808d7c-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:40 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1" returned: 0 in 0.478s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:40 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:40 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1 Apr 15 22:29:40 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:41 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf/volume-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1" returned: 0 in 0.395s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-quobyte-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1" released by "delete_volume" :: held 0.893s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG cinder.quota [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Created reservations ['f951115a-c5e7-4bd3-bf74-ef35d60feefe', '56476b24-3a18-4953-a227-32aa4da43bd2', 'f312e2fc-54f7-46c2-920a-20ad4e6d7983', '1e220654-29e2-44c0-b27a-50198b213073'] {{(pid=81921) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6': None} {{(pid=81921) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG cinder.volume.drivers.quobyte [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-32c242a0-df2c-4894-ba8e-20ea089fafa6'] {{(pid=81921) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.lockutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81921) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 22:29:41 devstack sudo[90742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf Apr 15 22:29:41 devstack sudo[90742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 22:29:41 devstack sudo[90742]: pam_unix(sudo:session): session closed for user root Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG oslo_concurrency.processutils [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e7093d5aec7a80ea8f0e5c5c5e063ebf" returned: 0 in 0.471s {{(pid=81921) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG cinder.manager [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Notifying Schedulers of capabilities ... {{(pid=81921) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 22:29:41 devstack cinder-volume[81921]: INFO cinder.volume.manager [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Deleted volume successfully. Apr 15 22:29:41 devstack cinder-volume[81921]: DEBUG cinder.coordination [None req-018eaa5d-4046-4f34-90a8-4faac26d36d3 tempest-CinderUnicodeTest-994650738 None] Lock "cinder-8dd6c6a1-8a04-47e2-ad10-35b42a85dbc1-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=81921) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 22:29:51 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=149,cinder:SELECT=112,cinder:INSERT=46,cinder:DELETE=14 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 22:29:51 devstack cinder-volume[81921]: DEBUG dbcounter [-] [81921] Writing DB stats cinder:UPDATE=166,cinder:DELETE=12,cinder:SELECT=104,cinder:INSERT=30 {{(pid=81921) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}